00010000:00010000:1.0F:1789117983.717304:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0F:1789117984.624787:0:17778:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:0.0:1789117984.624991:0:17778:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff962b88605540 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:0.0:1789117984.624997:0:17778:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962b9004ff00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff962b88605600 00000020:00080000:0.0:1789117984.625002:0:17778:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff962b9004fc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff962b8ed9dc00 00000020:00080000:2.0F:1789117984.625129:0:17840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:2.0:1789117984.625228:0:17840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789117984.625523:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2134a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117984.625537:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2134a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117984.625545:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2134a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117984.625552:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789117984.625558:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2134a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117984.625567:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2134a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117984.625656:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962a85f4bf00) 00010000:00010000:1.0:1789117984.625660:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789117984.625667:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2134a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117984.625675:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be2134a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117984.752243:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1789117985.131371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117985.131433:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117985.131458:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117985.131487:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117985.131514:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572218240 00000100:00100000:3.0:1789117985.131523:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572218240 00000100:00100000:3.0:1789117985.131586:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572218112 00000100:00100000:3.0:1789117985.131589:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572218112 00000100:00100000:3.0:1789117985.131615:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 86 00000100:00100000:3.0:1789117985.131625:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2406:x1876025572218240:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117985.131692:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2406:x1876025572218240:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 68us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117985.131699:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 86 00000100:00100000:3.0:1789117985.131717:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 87 00000100:00100000:3.0:1789117985.131723:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+12:2406:x1876025572218112:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117985.131750:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+12:2406:x1876025572218112:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117985.131757:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 87 00000100:00100000:1.0:1789117985.131850:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572217984 00000100:00100000:1.0:1789117985.131855:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572217984 00000100:00100000:1.0:1789117985.131896:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 174 00000100:00100000:1.0:1789117985.131903:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2406:x1876025572217984:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117985.131929:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2406:x1876025572217984:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117985.131945:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 174 00000100:00100000:1.0:1789117985.131996:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572218368 00000100:00100000:1.0:1789117985.132001:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572218368 00000100:00100000:1.0:1789117985.132029:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:1.0:1789117985.132036:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2406:x1876025572218368:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117985.132094:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2406:x1876025572218368:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 59us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117985.132113:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00080000:1.0:1789117985.132133:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789117985.132138:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117985.132139:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789117985.134989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117985.135147:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572218496 00000100:00100000:3.0:1789117985.135156:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572218496 00000100:00100000:3.0:1789117985.135214:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:3.0:1789117985.135223:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2403:x1876025572218496:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:3.0:1789117985.135251:0:19313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be21009 00000100:00080000:3.0:1789117985.135268:0:19313:0:(import.c:65:import_set_state_nolock()) ffff962a86cc8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789117985.135312:0:19313:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789117985.135470:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+2:2403:x1876025572218496:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 247us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117985.135494:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00010000:00010000:3.0:1789117985.135515:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789117985.137993:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117985.147427:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117985.147468:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117985.147504:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117985.147534:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117985.147566:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572218880 00000100:00100000:3.0:1789117985.147578:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572218880 00000100:00100000:3.0:1789117985.147648:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572219008 00000100:00100000:3.0:1789117985.147652:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572219008 00000100:00100000:3.0:1789117985.147676:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:3.0:1789117985.147687:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86809680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2403:x1876025572218880:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:3.0:1789117985.147721:0:19311:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be21041 00000100:00100000:2.0:1789117985.147813:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572218624 00000100:00100000:2.0:1789117985.147818:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572218624 00000100:00100000:2.0:1789117985.147865:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572218752 00000100:00100000:2.0:1789117985.147869:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572218752 00000100:00100000:2.0:1789117985.147890:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 88 00000100:00100000:2.0:1789117985.147897:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2407:x1876025572218624:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117985.147964:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2407:x1876025572218624:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 67us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117985.147972:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 88 00000100:00100000:2.0:1789117985.147990:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 89 00000100:00100000:2.0:1789117985.147997:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2406:x1876025572218752:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117985.148022:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2406:x1876025572218752:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 25us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117985.148028:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 89 00000100:00080000:3.0:1789117985.148328:0:19311:0:(import.c:65:import_set_state_nolock()) ffff962a885d3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789117985.148395:0:19311:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1789117985.148557:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86809680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+2:2403:x1876025572218880:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 871us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117985.148567:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:3.0:1789117985.148587:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:3.0:1789117985.148595:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88626580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2403:x1876025572219008:12345-192.168.204.30@tcp:9:kworker.0 00000020:00000080:3.0:1789117985.148611:0:19311:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be21048 00000100:00080000:3.0:1789117985.148617:0:19311:0:(import.c:65:import_set_state_nolock()) ffff962a885d7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789117985.148641:0:19311:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789117985.148703:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88626580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+2:2403:x1876025572219008:12345-192.168.204.30@tcp:9:kworker.0 Request processed in 109us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117985.148710:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 38 00010000:00010000:2.0:1789117985.148984:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117985.149376:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789117985.149388:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117985.149393:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117985.149395:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117985.149397:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789117985.637424:0:17834:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789117985.637434:0:17834:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117985.637458:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789117985.637468:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789117985.640934:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593284224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117985.641111:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117985.641186:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593284224 00000100:00100000:3.0:1789117985.641195:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593284224 00000100:00100000:3.0:1789117985.641252:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789117985.641262:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593284224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789117985.641307:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789117985.641354:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593284224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117985.641361:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789117985.641387:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117985.641430:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88625e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593284224:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789117985.769346:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117986.789253:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117987.176448:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593284352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117987.176657:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117987.176757:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593284352 00000100:00100000:2.0:1789117987.176764:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593284352 00000100:00100000:2.0:1789117987.176810:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789117987.176820:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593284352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117987.176875:0:17803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789117987.176927:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593284352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117987.176935:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789117987.177005:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593284352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117987.177273:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789117987.177284:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593284480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117987.177635:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117987.177676:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593284480 00000100:00100000:0.0:1789117987.177680:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593284480 00000100:00100000:0.0:1789117987.177711:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789117987.177718:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593284480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789117987.177739:0:18751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789117987.177797:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593284480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117987.177803:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789117987.177834:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593284480:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117987.459277:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117987.460434:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572219136 00000100:00100000:2.0:1789117987.460449:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572219136 00000100:00100000:2.0:1789117987.460667:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00100000:2.0:1789117987.460683:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a886270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+12:15842:x1876025572219136:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789117987.460833:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a886270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+12:15842:x1876025572219136:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 Request processed in 155us (1568us total) trans 0 rc 0/0 00000100:00080000:3.0:1789117987.461922:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117987.462432:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 74 00000100:00100000:3.0:1789117987.467178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117987.467800:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572219264 00000100:00100000:2.0:1789117987.467811:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572219264 00000100:00100000:2.0:1789117987.467955:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 75 00000100:00100000:2.0:1789117987.467968:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+5:15842:x1876025572219264:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789117987.468129:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+5:15842:x1876025572219264:12345-192.168.204.30@tcp:60:lhsmtool_posix.0 Request processed in 164us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117987.468136:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 75 00000100:00080000:3.0:1789117987.468388:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117987.473210:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117987.473565:0:17802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572219520 00000100:00100000:1.0:1789117987.473578:0:17802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572219520 00000100:00100000:1.0:1789117987.473643:0:17802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:1.0:1789117987.473654:0:17802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86d97050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+12:15842:x1876025572219520:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789117987.475043:0:17802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86d97050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+13:15842:x1876025572219520:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 292us (748us total) trans 8589934636 rc 0/0 00000100:00100000:1.0:1789117987.475083:0:17802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:0.0:1789117987.685411:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593284992:0@lo:400:kworker.0 00000100:00100000:0.0:1789117987.685485:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117987.685520:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593285504:0@lo:400:kworker.0 00000100:00100000:0.0:1789117987.685537:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117987.685559:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789117987.685564:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593284864:0@lo:400:kworker.0 00000100:00100000:0.0:1789117987.685584:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117987.685596:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593285376:0@lo:400:kworker.0 00000100:00100000:0.0:1789117987.685610:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117987.685623:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593285888:0@lo:400:kworker.0 00000100:00100000:0.0:1789117987.685647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117987.685673:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593284992 00000100:00100000:0.0:1789117987.685679:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593284992 00000100:00100000:0.0:1789117987.685729:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593285504 00000100:00100000:0.0:1789117987.685731:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593285504 00000100:00100000:0.0:1789117987.685750:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593285376 00000100:00100000:0.0:1789117987.685752:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593285376 00000100:00100000:0.0:1789117987.685759:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593285888 00000100:00100000:0.0:1789117987.685761:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593285888 00000100:00100000:0.0:1789117987.685774:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789117987.685781:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593284992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117987.685827:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593284992:12345-0@lo:400:kworker.0 Request processed in 46us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117987.685834:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789117987.685849:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789117987.685854:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593285504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117987.685874:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593285504:12345-0@lo:400:kworker.0 Request processed in 21us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117987.685879:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789117987.685888:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789117987.685894:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593285376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117987.685915:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593285376:12345-0@lo:400:kworker.0 Request processed in 22us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117987.685921:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789117987.685930:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789117987.685934:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eede580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593285888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117987.685953:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eede580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593285888:12345-0@lo:400:kworker.0 Request processed in 18us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117987.685965:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789117987.686001:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593285376:0@lo:400:kworker.0 00010000:00080000:0.0:1789117987.686014:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8eedf480 x1876025593285888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789117987.686025:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593285888:0@lo:400:kworker.0 00000100:00100000:0.0:1789117987.686033:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593284992:0@lo:400:kworker.0 00000100:00100000:0.0:1789117987.686041:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593285504:0@lo:400:kworker.0 00000100:00100000:2.0:1789117987.686251:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789117987.686264:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593286016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117987.686296:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117987.686848:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593284608:0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.686906:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117987.686942:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593285120:0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.686985:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117987.687006:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593285632:0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.687025:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117987.687041:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789117987.687046:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593284736:0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.687093:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117987.687108:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593285248:0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.687124:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117987.687136:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593285760:0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.687152:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117987.687176:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593284864 00000100:00100000:3.0:1789117987.687181:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593284864 00000100:00100000:3.0:1789117987.687211:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593285120 00000100:00100000:3.0:1789117987.687213:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593285120 00000100:00100000:3.0:1789117987.687222:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593284736 00000100:00100000:3.0:1789117987.687224:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593284736 00000100:00100000:3.0:1789117987.687234:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593285248 00000100:00100000:3.0:1789117987.687236:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593285248 00000100:00100000:3.0:1789117987.687248:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789117987.687256:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593284864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.687298:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593284864:12345-0@lo:400:kworker.0 Request processed in 43us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117987.687304:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789117987.687319:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789117987.687325:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593285120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.687354:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593285120:12345-0@lo:400:kworker.0 Request processed in 30us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117987.687359:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789117987.687382:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789117987.687387:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593284736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.687414:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593284736:12345-0@lo:400:kworker.0 Request processed in 27us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117987.687419:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789117987.687430:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789117987.687436:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593285248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.687462:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593285248:12345-0@lo:400:kworker.0 Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117987.687467:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789117987.687483:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593286016 00000100:00100000:3.0:1789117987.687486:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593286016 00000100:00100000:3.0:1789117987.687508:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789117987.687515:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593286016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117987.687553:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789117987.687591:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593286016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117987.687597:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1789117987.687624:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789117987.687628:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789117987.687630:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117987.687633:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117987.687642:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593285632 00000100:00100000:3.0:1789117987.687646:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593285632 00000100:00100000:3.0:1789117987.687682:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593285760 00000100:00100000:3.0:1789117987.687685:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593285760 00000100:00100000:3.0:1789117987.687704:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789117987.687710:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593285632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.687748:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593285632:12345-0@lo:400:kworker.0 Request processed in 39us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117987.687754:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789117987.687766:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789117987.687771:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593285760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.687794:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593285760:12345-0@lo:400:kworker.0 Request processed in 23us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117987.687799:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789117987.687844:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593286016:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789117987.687863:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117987.687865:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789117987.687876:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1789117987.687880:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962ba0719a40, transno 8589934596 00000004:00080000:3.0:1789117987.687891:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1789117987.687906:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593284736:0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.687915:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593285248:0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.687923:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593285760:0@lo:400:kworker.0 00000100:00100000:3.0:1789117987.687932:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593285120:0@lo:400:kworker.0 00010000:00080000:3.0:1789117987.687942:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87d9c780 x1876025593285632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117987.687951:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593285632:0@lo:400:kworker.0 00000100:00100000:2.0:1789117987.688109:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593286144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789117987.688137:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117987.688152:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593284608 00000100:00100000:2.0:1789117987.688161:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593286144 00000100:00100000:1.0:1789117987.688161:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593284608 00000100:00100000:2.0:1789117987.688164:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593286144 00000100:00100000:2.0:1789117987.688183:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789117987.688186:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789117987.688189:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593286144:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117987.688191:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3644:x1876025593284608:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789117987.688204:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789117987.688227:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3644:x1876025593284608:12345-0@lo:400:kworker.0 Request processed in 37us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117987.688233:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593286144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117987.688234:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789117987.688239:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789117987.688404:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593286144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117987.688413:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593284608:0@lo:400:kworker.0 00000100:00100000:0.0:1789117987.689422:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593284864:0@lo:400:kworker.0 00000100:00100000:2.0:1789117987.689691:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117987.689705:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593286272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789117987.689782:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117987.689945:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593286272 00000100:00100000:0.0:1789117987.689951:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593286272 00000100:00100000:0.0:1789117987.690015:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789117987.690024:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593286272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789117987.690046:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789117987.690125:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593286272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117987.690133:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789117987.690995:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593286272:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789117987.816676:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117988.837417:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117989.864076:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117990.241350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117990.241402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117990.241460:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117990.241487:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117990.241503:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117990.241524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117990.241559:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572219648 00000100:00100000:1.0:1789117990.241570:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572219648 00000100:00100000:1.0:1789117990.241631:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 176 00000100:00100000:1.0:1789117990.241643:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2405:x1876025572219648:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117990.241710:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2405:x1876025572219648:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 70us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117990.241718:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 176 00000100:00100000:0.0:1789117990.241883:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572220032 00000100:00100000:0.0:1789117990.241887:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572220032 00000100:00100000:0.0:1789117990.241941:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:0.0:1789117990.241949:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2404:x1876025572220032:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789117990.241980:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2404:x1876025572220032:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 33us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117990.241985:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:3.0:1789117990.242084:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572219776 00000100:00100000:3.0:1789117990.242088:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572219776 00000100:00100000:3.0:1789117990.242125:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572220288 00000100:00100000:3.0:1789117990.242127:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572220288 00000100:00100000:3.0:1789117990.242141:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572219904 00000100:00100000:3.0:1789117990.242143:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572219904 00000100:00100000:3.0:1789117990.242153:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572220160 00000100:00100000:3.0:1789117990.242155:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572220160 00000100:00100000:3.0:1789117990.242167:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 96 00000100:00100000:3.0:1789117990.242174:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+13:2404:x1876025572219776:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117990.242209:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+13:2404:x1876025572219776:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 35us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117990.242216:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 96 00000100:00100000:3.0:1789117990.242231:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 97 00000100:00100000:3.0:1789117990.242237:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2404:x1876025572220288:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117990.242260:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2404:x1876025572220288:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 24us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117990.242267:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 97 00000100:00100000:3.0:1789117990.242279:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 98 00000100:00100000:3.0:1789117990.242284:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2405:x1876025572219904:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117990.242306:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2405:x1876025572219904:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 21us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117990.242311:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 98 00000100:00100000:3.0:1789117990.242322:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 99 00000100:00100000:3.0:1789117990.242327:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2405:x1876025572220160:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117990.242348:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2405:x1876025572220160:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 21us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117990.242362:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 99 00000100:00080000:1.0:1789117990.242719:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789117990.242724:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789117990.242726:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117990.762077:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789117990.762114:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bb5c8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593286400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117990.762198:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117990.762260:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593286400 00000100:00100000:3.0:1789117990.762271:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593286400 00000100:00100000:3.0:1789117990.762338:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789117990.762348:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593286400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789117990.762380:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789117990.762430:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593286400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117990.762439:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789117990.762653:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bb5c8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593286400:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789117990.764870:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1789117990.770726:0:20127:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3a40d558-cfad-4484-8c6e-52e7fbfb6447 00000020:00000080:3.0:1789117990.770742:0:20127:0:(genops.c:885:class_export_put()) final put ffff962a885d2800/3a40d558-cfad-4484-8c6e-52e7fbfb6447 00000001:00100000:3.0:1789117990.770771:0:20127:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 369a8077-26bb-4780-baf3-16abc59c8ae5 00000020:00000080:3.0:1789117990.770774:0:20127:0:(genops.c:885:class_export_put()) final put ffff962a86ccc800/369a8077-26bb-4780-baf3-16abc59c8ae5 00000001:00100000:2.0:1789117990.770964:0:19307:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3a40d558-cfad-4484-8c6e-52e7fbfb6447 00000020:00000080:2.0:1789117990.770969:0:19307:0:(genops.c:885:class_export_put()) final put ffff962a885d1000/3a40d558-cfad-4484-8c6e-52e7fbfb6447 00000020:00000080:1.0:1789117990.772644:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a885d2800/3a40d558-cfad-4484-8c6e-52e7fbfb6447 for lustre-OST0001 00000020:00000080:1.0:1789117990.772778:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a86ccc800/369a8077-26bb-4780-baf3-16abc59c8ae5 for lustre-OST0001 00000020:00000080:1.0:1789117990.772798:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a885d1000/3a40d558-cfad-4484-8c6e-52e7fbfb6447 for lustre-OST0000 00000001:00080000:2.0:1789117990.773010:0:17778:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:2.0:1789117990.773020:0:17778:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00000080:1.0:1789117990.773565:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a885d7000 for lustre-OST0001 00000020:00000080:1.0:1789117990.773572:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a86cc8800 for lustre-OST0001 00000020:00000080:1.0:1789117990.773575:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a885d3800 for lustre-OST0000 00000020:00080000:0.0:1789117990.773690:0:17840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:0.0:1789117990.773704:0:17840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:3.0:1789117990.886839:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117991.909494:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117992.294803:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117992.294829:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593286528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117992.294900:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117992.295036:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593286528 00000100:00100000:2.0:1789117992.295044:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593286528 00000100:00100000:2.0:1789117992.295116:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789117992.295125:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593286528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789117992.295163:0:17804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789117992.295210:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593286528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117992.295217:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789117992.295301:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593286528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789117992.304334:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a81a0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593286656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117992.304413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117992.304574:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593286656 00000100:00100000:3.0:1789117992.304581:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593286656 00000100:00100000:3.0:1789117992.304643:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789117992.304656:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593286656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789117992.304700:0:17803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789117992.310840:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593286656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6176us (6416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117992.310874:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789117992.314149:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a81a0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593286656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789117992.806050:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bb5c8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593286784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789117992.806162:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117992.806270:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593286784 00000100:00100000:3.0:1789117992.806281:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593286784 00000100:00100000:3.0:1789117992.806351:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789117992.806363:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593286784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789117992.806419:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789117992.806849:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593286912:0@lo:400:kworker.0 00000100:00100000:1.0:1789117992.806898:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117992.806944:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789117992.806950:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593287040:0@lo:400:kworker.0 00000100:00100000:1.0:1789117992.806988:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117992.807020:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593287040 00000100:00100000:1.0:1789117992.807025:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593287040 00000100:00100000:1.0:1789117992.807091:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789117992.807099:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593287040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117992.807144:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593287040:12345-0@lo:400:kworker.0 Request processed in 45us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117992.807153:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789117992.807200:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593287040:0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.811930:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593286784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5556us (5754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117992.811963:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789117992.812106:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593287168:0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.812183:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117992.812228:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117992.812234:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bb5c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593287296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117992.812260:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789117992.812289:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117992.812306:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593287296 00000100:00100000:3.0:1789117992.812315:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593287296 00000100:00100000:3.0:1789117992.812357:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789117992.812367:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593287296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789117992.812598:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789117992.812651:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593287296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 285us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117992.812658:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789117992.812691:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593287168 00000100:00100000:3.0:1789117992.812695:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593287168 00000100:00100000:3.0:1789117992.812725:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789117992.812732:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593287168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.812782:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593287168:12345-0@lo:400:kworker.0 Request processed in 51us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117992.812789:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1789117992.812810:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789117992.812813:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789117992.812845:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bb5c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593287296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789117992.812858:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593287168:0@lo:400:kworker.0 00000100:00100000:2.0:1789117992.814650:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bb5c8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593286784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789117992.814781:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593286912 00000100:00100000:2.0:1789117992.814787:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593286912 00000100:00100000:2.0:1789117992.814856:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789117992.814866:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3646:x1876025593286912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117992.814979:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3646:x1876025593286912:12345-0@lo:400:kworker.0 Request processed in 115us (8080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117992.814989:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789117992.815648:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593287808:0@lo:400:kworker.0 00000100:00100000:2.0:1789117992.815694:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117992.815731:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eede940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593288320:0@lo:400:kworker.0 00000100:00100000:2.0:1789117992.815754:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117992.815773:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789117992.815779:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593287680:0@lo:400:kworker.0 00000100:00100000:2.0:1789117992.815805:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117992.815821:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593288192:0@lo:400:kworker.0 00000100:00100000:2.0:1789117992.815844:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117992.815872:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593287808 00000100:00100000:2.0:1789117992.815877:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593287808 00000100:00100000:2.0:1789117992.815925:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789117992.815934:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593287808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117992.815992:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593287808:12345-0@lo:400:kworker.0 Request processed in 59us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117992.816000:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789117992.816038:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593287808:0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.816595:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593287424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117992.816634:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117992.816665:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593287936:0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.816687:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117992.816707:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593288448:0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.816729:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117992.816756:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593286912:0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.816770:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789117992.816778:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593287552:0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.816800:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117992.816810:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eeded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593288064:0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.816828:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117992.816849:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593288320 00000100:00100000:3.0:1789117992.816853:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593288320 00000100:00100000:3.0:1789117992.817002:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593288192 00000100:00100000:3.0:1789117992.817006:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593288192 00000100:00100000:3.0:1789117992.817023:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593287936 00000100:00100000:3.0:1789117992.817026:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593287936 00000100:00100000:3.0:1789117992.817076:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593288448 00000100:00100000:3.0:1789117992.817080:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593288448 00000100:00100000:3.0:1789117992.817094:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593287552 00000100:00100000:3.0:1789117992.817096:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593287552 00000100:00100000:3.0:1789117992.817106:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593288064 00000100:00100000:3.0:1789117992.817108:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593288064 00000100:00100000:3.0:1789117992.817122:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789117992.817129:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593288320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.817173:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593288320:12345-0@lo:400:kworker.0 Request processed in 44us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117992.817180:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789117992.817197:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789117992.817202:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd005e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593288192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.817232:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd005e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593288192:12345-0@lo:400:kworker.0 Request processed in 31us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117992.817238:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789117992.817250:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789117992.817257:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593287936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.817287:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593287936:12345-0@lo:400:kworker.0 Request processed in 31us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117992.817293:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789117992.817303:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789117992.817309:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593288448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.817351:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593288448:12345-0@lo:400:kworker.0 Request processed in 42us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117992.817356:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789117992.817368:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789117992.817380:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593287552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.817409:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593287552:12345-0@lo:400:kworker.0 Request processed in 30us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117992.817415:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789117992.817426:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789117992.818739:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593287424 00000100:00100000:2.0:1789117992.818760:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593287424 00000100:00100000:2.0:1789117992.818812:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789117992.818820:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593287424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789117992.818851:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789117992.818911:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593287424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117992.818919:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789117992.819633:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593288064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.819694:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593288064:12345-0@lo:400:kworker.0 Request processed in 2261us (2864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117992.819702:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789117992.819740:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593287680 00000100:00100000:3.0:1789117992.819748:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593287680 00000100:00100000:3.0:1789117992.819797:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789117992.819804:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593287680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.819848:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593287680:12345-0@lo:400:kworker.0 Request processed in 44us (4042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117992.819853:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1789117992.819895:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789117992.819902:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789117992.819906:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117992.819969:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593287552:0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.819986:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eeded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593288064:0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.820008:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593287424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789117992.820020:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593287936:0@lo:400:kworker.0 00010000:00080000:3.0:1789117992.820038:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8eede1c0 x1876025593288448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117992.820094:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593288448:0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.820152:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593287680:0@lo:400:kworker.0 00010000:00080000:3.0:1789117992.820167:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8eedde00 x1876025593288192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117992.820176:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593288192:0@lo:400:kworker.0 00000100:00100000:3.0:1789117992.820188:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eede940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593288320:0@lo:400:kworker.0 00010000:00010000:2.0:1789117992.936223:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789117992.998013:0:18556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1789117993.355554:0:21187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 05:13:11 (1789117991) 00010000:00010000:3.0:1789117993.957570:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117994.981989:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117995.365613:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117995.365668:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117995.365700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117995.365732:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117995.365756:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117995.365786:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572220544 00000100:00100000:3.0:1789117995.365795:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572220544 00000100:00100000:3.0:1789117995.365866:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572221056 00000100:00100000:3.0:1789117995.365869:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572221056 00000100:00100000:3.0:1789117995.365883:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572220672 00000100:00100000:3.0:1789117995.365885:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572220672 00000100:00100000:3.0:1789117995.365901:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 106 00000100:00100000:3.0:1789117995.365923:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+12:2404:x1876025572220544:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789117995.366006:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369a8077-26bb-4780-baf3-16abc59c8ae5+12:2404:x1876025572220544:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 85us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117995.366392:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572220800 00000100:00100000:2.0:1789117995.366397:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572220800 00000100:00100000:2.0:1789117995.366438:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:2.0:1789117995.366446:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2404:x1876025572220800:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117995.366481:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2404:x1876025572220800:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 37us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117995.366488:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00080000:2.0:1789117995.366538:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789117995.366544:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789117995.366546:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789117995.366561:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 107 00000100:00100000:2.0:1789117995.366571:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2404:x1876025572221056:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117995.366601:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2404:x1876025572221056:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 34us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117995.366607:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 107 00000100:00100000:2.0:1789117995.366626:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 108 00000100:00100000:2.0:1789117995.366632:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bb5c8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2404:x1876025572220672:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117995.366688:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bb5c8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2404:x1876025572220672:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 56us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117995.366694:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 108 00000100:00100000:1.0:1789117995.366858:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572220416 00000100:00100000:1.0:1789117995.366865:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572220416 00000100:00100000:1.0:1789117995.366921:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 178 00000100:00100000:1.0:1789117995.366928:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2404:x1876025572220416:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789117995.366965:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2404:x1876025572220416:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 38us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117995.366972:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 178 00000100:00100000:3.0:1789117995.367469:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 106 00000100:00100000:3.0:1789117995.368157:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117995.368238:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572220928 00000100:00100000:2.0:1789117995.368245:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572220928 00000100:00100000:2.0:1789117995.368316:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 109 00000100:00100000:2.0:1789117995.368325:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2404:x1876025572220928:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789117995.368400:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2404:x1876025572220928:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117995.368407:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 109 00000100:00080000:3.0:1789117995.369032:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789117995.878977:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a887f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593288576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789117995.879128:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117995.879204:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593288576 00000100:00100000:3.0:1789117995.879211:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593288576 00000100:00100000:3.0:1789117995.879273:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789117995.879283:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81aafc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593288576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789117995.879317:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789117995.879362:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81aafc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593288576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117995.879370:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000040:00080000:1.0:1789117995.879664:0:17834:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789117995.879669:0:17834:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789117995.879689:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789117995.879694:0:17834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00080000:3.0:1789117995.879788:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789117995.879827:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a887f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593288576:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789117996.005788:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117997.029358:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789117997.413944:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789117997.413975:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbd006940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593288704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789117997.415779:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117997.417051:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789117997.417204:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a81a0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593288832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789117997.417275:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117997.417454:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593288704 00000100:00100000:3.0:1789117997.417463:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593288704 00000100:00100000:3.0:1789117997.417506:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593288832 00000100:00100000:3.0:1789117997.417509:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593288832 00000100:00100000:3.0:1789117997.417524:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789117997.417533:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593288704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789117997.417614:0:17803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789117997.417677:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593288704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117997.417684:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789117997.417703:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789117997.417710:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a887f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593288832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789117997.417725:0:17803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789117997.419251:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a887f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593288832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1532us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789117997.419264:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789117997.419344:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a81a0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593288832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789117997.421251:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbd006940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593288704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789117997.763342:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117997.763392:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117997.763512:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572221184 00000100:00100000:2.0:1789117997.763601:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572221312 00000100:00100000:3.0:1789117997.763607:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572221184 00000100:00100000:2.0:1789117997.763615:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572221312 00000100:00100000:2.0:1789117997.763786:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:2.0:1789117997.763798:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+14:2404:x1876025572221312:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117997.763817:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117997.763836:0:17783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92c00/0xaa253ed19be20fe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f247 expref: 14 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117997.763855:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117997.763924:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+13:2404:x1876025572221312:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 129us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117997.763938:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:2.0:1789117997.763957:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:2.0:1789117997.763963:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+12:2404:x1876025572221184:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789117997.763986:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789117997.763996:0:17783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92800/0xaa253ed19be20fdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f216 expref: 12 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117997.764004:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789117997.764020:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:2404:x1876025572221184:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 57us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117997.764026:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:1.0:1789117997.775199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789117997.775241:0:17784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572221440 00000100:00100000:0.0:1789117997.775257:0:17784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572221440 00000100:00100000:0.0:1789117997.775349:0:17784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:0.0:1789117997.775360:0:17784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:2404:x1876025572221440:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789117997.775377:0:17784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789117997.775401:0:17784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a88d9a400/0xaa253ed19be2106b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2fd expref: 11 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117997.775420:0:17784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789117997.775495:0:17784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+10:2404:x1876025572221440:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 137us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117997.775503:0:17784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:1.0:1789117997.777160:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117997.777232:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572221696 00000100:00100000:1.0:1789117997.777253:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572221696 00000100:00100000:1.0:1789117997.777470:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:1.0:1789117997.777508:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+6:2403:x1876025572221696:12345-192.168.204.30@tcp:9:umount.0 00000100:00080000:0.0:1789117997.777531:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1789117997.777579:0:19311:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be21002 00000020:00010000:1.0:1789117997.777659:0:19311:0:(genops.c:1921:obd_stale_export_put()) Put export ffff962a86a78000: total 0 00000100:00080000:1.0:1789117997.777667:0:19311:0:(import.c:65:import_set_state_nolock()) ffff962a86a7d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789117997.777748:0:19311:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000020:00010000:0.0:1789117997.778225:0:17786:0:(genops.c:1907:obd_stale_export_get()) Get export ffff962a86a78000: total 0 00010000:00010000:0.0:1789117997.778233:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117997.778301:0:17786:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff962a86a78000, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1789117997.778672:0:17786:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789117997.778677:0:17786:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1789117978 -> 1789117980 00002000:00010000:0.0:1789117997.778681:0:17786:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789117978 -> 1789117980 00002000:00010000:0.0:1789117997.778683:0:17786:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789117997.778718:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002215c160/0xaa253ed19be21374 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3dd expref: 4 pid: 20393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789117997.778773:0:17786:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff962a86a78000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789117997.778788:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117997.778790:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789117997.778792:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117997.779418:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369a8077-26bb-4780-baf3-16abc59c8ae5+2:2403:x1876025572221696:12345-192.168.204.30@tcp:9:umount.0 Request processed in 1908us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117997.779430:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:1.0:1789117997.790562:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117997.790654:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572222592 00000100:00100000:3.0:1789117997.790669:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572222592 00000100:00100000:3.0:1789117997.790783:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 76 00000100:00100000:3.0:1789117997.790797:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+12:2403:x1876025572222592:12345-192.168.204.30@tcp:39:umount.0 00000020:00000080:3.0:1789117997.790846:0:17800:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20ff4 00000020:00010000:3.0:1789117997.790878:0:17800:0:(genops.c:1921:obd_stale_export_put()) Put export ffff962a86cce800: total 0 00000100:00080000:3.0:1789117997.790885:0:17800:0:(import.c:65:import_set_state_nolock()) ffff962a86cc8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789117997.790928:0:17800:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000020:00010000:2.0:1789117997.791121:0:18557:0:(genops.c:1907:obd_stale_export_get()) Get export ffff962a86cce800: total 0 00010000:00010000:2.0:1789117997.791222:0:18557:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff962a86cce800, canceled 0 locks, left on hash table 7. 00000100:00100000:3.0:1789117997.791227:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369a8077-26bb-4780-baf3-16abc59c8ae5+11:2403:x1876025572222592:12345-192.168.204.30@tcp:39:umount.0 Request processed in 433us (683us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1789117997.791238:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 76 00010000:00010000:2.0:1789117997.791278:0:18557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962a85f4ba00) 00010000:00010000:2.0:1789117997.791397:0:18557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117997.791470:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93200/0xaa253ed19be2111a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f319 expref: 10 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789117997.792127:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789117997.798417:0:18557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:2.0:1789117997.798428:0:18557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789117997.798440:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9ba00/0xaa253ed19be212c5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3a5 expref: 9 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117997.798468:0:18557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff962b95e52400) 00010000:00010000:2.0:1789117997.798471:0:18557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789117997.798476:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a88d9a000/0xaa253ed19be21389 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3e4 expref: 8 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117997.798520:0:18557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff962b832ccb00) 00010000:00010000:2.0:1789117997.798523:0:18557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789117997.798548:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10000/0xaa253ed19be210bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f304 expref: 7 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117997.798568:0:18557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff962b95e52d00) 00010000:00010000:2.0:1789117997.798571:0:18557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789117997.798575:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70d600/0xaa253ed19be2119f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f343 expref: 6 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117997.798594:0:18557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff962a85f4bf00) 00010000:00010000:2.0:1789117997.798596:0:18557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789117997.798600:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21320 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f3ba expref: 5 pid: 17799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117997.798615:0:18557:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962b95e52b00) 00010000:00010000:2.0:1789117997.798617:0:18557:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789117997.798620:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbf70de00/0xaa253ed19be210db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f30b expref: 4 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789117997.798635:0:18557:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff962a86cce800, canceled 7 locks, left on hash table 0. 00010000:00010000:2.0:1789117997.798678:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117997.798681:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117997.798683:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117997.806150:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117997.806271:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572222720 00000100:00100000:2.0:1789117997.806289:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572222720 00000100:00100000:2.0:1789117997.806397:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:2.0:1789117997.806411:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+5:2403:x1876025572222720:12345-192.168.204.30@tcp:39:umount.0 00000020:00000080:2.0:1789117997.806447:0:17799:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20ffb 00000100:00080000:2.0:1789117997.806466:0:17799:0:(import.c:65:import_set_state_nolock()) ffff962a86a7a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789117997.806491:0:17799:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1789117997.806519:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789117997.806567:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789117997.806795:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369a8077-26bb-4780-baf3-16abc59c8ae5+3:2403:x1876025572222720:12345-192.168.204.30@tcp:39:umount.0 Request processed in 386us (671us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789117997.806806:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 77 00000100:00100000:3.0:1789117997.926125:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593288960:0@lo:400:kworker.0 00000100:00100000:3.0:1789117997.926258:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117997.926340:0:17790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593288960 00000100:00100000:2.0:1789117997.926354:0:17790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593288960 00000100:00100000:2.0:1789117997.926415:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789117997.926426:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3646:x1876025593288960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117997.926519:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3646:x1876025593288960:12345-0@lo:400:kworker.0 Request processed in 95us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117997.926527:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789117997.926670:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593289216:0@lo:400:kworker.0 00000100:00100000:0.0:1789117997.926808:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593289344:0@lo:400:kworker.0 00000100:00100000:3.0:1789117997.926865:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593288960:0@lo:400:kworker.0 00000100:00100000:3.0:1789117997.926875:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593289472:0@lo:400:kworker.0 00000100:00100000:1.0:1789117997.927006:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf726580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593289088:0@lo:400:kworker.0 00000100:00100000:2.0:1789117997.936348:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117997.936408:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593289728:0@lo:400:kworker.0 00000100:00100000:2.0:1789117997.936441:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117997.936460:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf725e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593290240:0@lo:400:kworker.0 00000100:00100000:2.0:1789117997.936486:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117997.936527:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593290752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117997.936552:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117997.936604:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593289216 00000100:00100000:2.0:1789117997.936612:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593289216 00000100:00100000:2.0:1789117997.936682:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593289728 00000100:00100000:2.0:1789117997.936686:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593289728 00000100:00100000:2.0:1789117997.936717:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789117997.936726:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd006580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593289216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117997.936790:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd006580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593289216:12345-0@lo:400:kworker.0 Request processed in 65us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117997.936816:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789117997.936834:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789117997.936841:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd006940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593289728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117997.936885:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd006940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593289728:12345-0@lo:400:kworker.0 Request processed in 45us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117997.936891:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789117997.936913:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593290752 00000100:00100000:2.0:1789117997.936916:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593290752 00000100:00100000:2.0:1789117997.936945:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789117997.936951:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593290752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789117997.936974:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789117997.937007:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593290752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117997.937013:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1789117997.937028:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789117997.937032:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789117997.937097:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593290752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789117997.937110:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593289216:0@lo:400:kworker.0 00000100:00100000:2.0:1789117997.937118:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593289728:0@lo:400:kworker.0 00000100:00100000:2.0:1789117997.937196:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789117997.937205:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593290880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789117997.937233:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789117997.937258:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593290880 00000100:00100000:2.0:1789117997.937262:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593290880 00000100:00100000:2.0:1789117997.937288:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789117997.937301:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593290880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789117997.937313:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789117997.937343:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593290880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117997.937349:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1789117997.937363:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789117997.937384:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593290880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789117997.937411:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593290240 00000100:00100000:2.0:1789117997.937415:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593290240 00000100:00100000:2.0:1789117997.937464:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789117997.937472:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593290240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117997.937506:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593290240:12345-0@lo:400:kworker.0 Request processed in 36us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117997.937513:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1789117997.937526:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789117997.937543:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf725e00 x1876025593290240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789117997.937554:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf725e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593290240:0@lo:400:kworker.0 00000100:00100000:0.0:1789117997.939332:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117997.939415:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf725680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593289856:0@lo:400:kworker.0 00000100:00100000:0.0:1789117997.939463:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117997.939524:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593289344 00000100:00100000:0.0:1789117997.939534:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593289344 00000100:00100000:0.0:1789117997.939601:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593289856 00000100:00100000:0.0:1789117997.939605:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593289856 00000100:00100000:0.0:1789117997.939632:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789117997.939643:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593289344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117997.939710:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593289344:12345-0@lo:400:kworker.0 Request processed in 69us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117997.939719:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789117997.939743:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789117997.939750:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593289856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117997.939780:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593289856:12345-0@lo:400:kworker.0 Request processed in 31us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117997.939787:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789117997.939846:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf725680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593289856:0@lo:400:kworker.0 00000100:00100000:0.0:1789117997.939867:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593290368:0@lo:400:kworker.0 00000100:00100000:0.0:1789117997.939921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117997.939955:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593290368 00000100:00100000:0.0:1789117997.939960:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593290368 00000100:00100000:0.0:1789117997.940047:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789117997.940081:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eede940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593290368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117997.940121:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eede940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593290368:12345-0@lo:400:kworker.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789117997.940128:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1789117997.940949:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789117997.941113:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593290368:0@lo:400:kworker.0 00000100:00100000:0.0:1789117997.941187:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593289344:0@lo:400:kworker.0 00000100:00100000:3.0:1789117997.942928:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117997.943086:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf725a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593289984:0@lo:400:kworker.0 00000100:00100000:3.0:1789117997.943127:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117997.943218:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593290496:0@lo:400:kworker.0 00000100:00100000:3.0:1789117997.943243:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789117997.943616:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593289472 00000100:00100000:0.0:1789117997.943629:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593289472 00000100:00100000:2.0:1789117997.943667:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593289984 00000100:00100000:2.0:1789117997.943687:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593289984 00000100:00100000:0.0:1789117997.943730:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593290496 00000100:00100000:0.0:1789117997.943737:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593290496 00000100:00100000:2.0:1789117997.943776:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789117997.943789:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593289472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789117997.943882:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789117997.943896:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf724f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593289984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117997.943910:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593289472:12345-0@lo:400:kworker.0 Request processed in 120us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117997.943922:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789117997.943957:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789117997.943970:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf724f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593289984:12345-0@lo:400:kworker.0 Request processed in 76us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117997.943998:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593290496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789117997.944045:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593290496:12345-0@lo:400:kworker.0 Request processed in 53us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117997.944092:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:3.0:1789117997.944158:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf724b40 x1876025593290496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789117997.944179:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593290496:0@lo:400:kworker.0 00000100:00100000:1.0:1789117997.944188:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789117997.944238:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593289472:0@lo:400:kworker.0 00000100:00100000:3.0:1789117997.944249:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf725a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593289984:0@lo:400:kworker.0 00000100:00100000:1.0:1789117997.944740:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593289600:0@lo:400:kworker.0 00000100:00100000:1.0:1789117997.944832:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117997.944873:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf726d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593290112:0@lo:400:kworker.0 00000100:00100000:1.0:1789117997.944901:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117997.944936:0:17799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593290112 00000100:00100000:1.0:1789117997.944942:0:17799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593290112 00000100:00100000:1.0:1789117997.945088:0:17799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789117997.945098:0:17799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86bbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593290112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117997.945144:0:17799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86bbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593290112:12345-0@lo:400:kworker.0 Request processed in 48us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117997.945152:0:17799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789117997.945211:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf726d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593290112:0@lo:400:kworker.0 00000100:00100000:1.0:1789117997.945219:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbd007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593290624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117997.945606:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789117997.945644:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593290624 00000100:00100000:1.0:1789117997.945649:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593290624 00000100:00100000:1.0:1789117997.945682:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789117997.945690:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593290624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789117997.945723:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789117997.945762:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed7a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593290624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117997.945769:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789117997.945936:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593289088 00000100:00100000:3.0:1789117997.945943:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593289088 00000100:00100000:3.0:1789117997.945977:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593289600 00000100:00100000:3.0:1789117997.945980:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593289600 00000100:00100000:0.0:1789117997.946154:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1789117997.946192:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789117997.946198:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789117997.946212:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbd007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593290624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789117997.946401:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789117997.946412:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593289088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117997.946489:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593289088:12345-0@lo:400:kworker.0 Request processed in 79us (2306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117997.946498:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789117997.946519:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789117997.946526:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0719a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593289600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789117997.946565:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0719a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593289600:12345-0@lo:400:kworker.0 Request processed in 39us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117997.946574:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789117997.947143:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf726580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593289088:0@lo:400:kworker.0 00000100:00100000:0.0:1789117997.947158:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593289600:0@lo:400:kworker.0 00010000:00010000:0.0:1789117998.053388:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789117999.077508:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789117999.696049:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117999.696535:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117999.700359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117999.712350:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789117999.712552:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572223360 00000100:00100000:3.0:1789117999.712567:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572223360 00000100:00100000:3.0:1789117999.712708:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 78 00000100:00100000:3.0:1789117999.712723:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf727840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+6:2403:x1876025572223360:12345-192.168.204.30@tcp:39:umount.0 00000020:00000080:3.0:1789117999.712787:0:17798:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be21033 00000020:00010000:3.0:1789117999.712832:0:17798:0:(genops.c:1921:obd_stale_export_put()) Put export ffff962a86cc0800: total 0 00000100:00080000:3.0:1789117999.712838:0:17798:0:(import.c:65:import_set_state_nolock()) ffff962a86cc0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789117999.712871:0:17798:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:3.0:1789117999.713130:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf727840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2403:x1876025572223360:12345-192.168.204.30@tcp:39:umount.0 Request processed in 410us (799us total) trans 8589934638 rc 0/0 00000100:00100000:3.0:1789117999.713140:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 78 00000020:00010000:3.0:1789117999.713203:0:17787:0:(genops.c:1907:obd_stale_export_get()) Get export ffff962a86cc0800: total 0 00010000:00010000:3.0:1789117999.713273:0:17787:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff962a86cc0800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789117999.713541:0:17787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962a85f4ba00) 00010000:00010000:3.0:1789117999.713545:0:17787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789117999.713555:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10a00/0xaa253ed19be21128 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f320 expref: 4 pid: 17800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789117999.713586:0:17787:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff962a86cc0800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789117999.713599:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117999.713602:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789117999.713604:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789117999.713784:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789117999.714196:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572222848 00000100:00100000:1.0:1789117999.714204:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572222848 00000100:00100000:1.0:1789117999.714329:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572222976 00000100:00100000:1.0:1789117999.714334:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572222976 00000100:00100000:1.0:1789117999.714531:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572223104 00000100:00100000:1.0:1789117999.714536:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572223104 00000100:00100000:1.0:1789117999.714562:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:1.0:1789117999.714635:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf725a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+12:2406:x1876025572222848:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117999.714655:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117999.714673:0:17785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70da00/0xaa253ed19be2101e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f286 expref: 12 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117999.714758:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117999.714840:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf725a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+11:2406:x1876025572222848:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 211us (18812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117999.714848:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:1.0:1789117999.714870:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:1.0:1789117999.714877:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+10:2406:x1876025572222976:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117999.714907:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117999.714919:0:17785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70c800/0xaa253ed19be21025 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2b7 expref: 10 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117999.714932:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117999.714954:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+9:2406:x1876025572222976:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 78us (18422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117999.714962:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:1.0:1789117999.714980:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1789117999.714987:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf724b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+8:2404:x1876025572223104:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789117999.714996:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789117999.715007:0:17785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d93a00/0xaa253ed19be21064 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f2f6 expref: 8 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117999.715016:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789117999.715043:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf724b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+7:2404:x1876025572223104:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 56us (14706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789117999.715050:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:3.0:1789117999.731538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789117999.731641:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572223488 00000100:00100000:1.0:1789117999.731658:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572223488 00000100:00100000:1.0:1789117999.731803:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:1.0:1789117999.731819:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+5:2403:x1876025572223488:12345-192.168.204.30@tcp:39:umount.0 00000100:00080000:3.0:1789117999.731884:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:1.0:1789117999.731894:0:17800:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be2103a 00000100:00080000:1.0:1789117999.731908:0:17800:0:(import.c:65:import_set_state_nolock()) ffff962a885d2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789117999.731953:0:17800:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:3.0:1789117999.732037:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789117999.733185:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a40d558-cfad-4484-8c6e-52e7fbfb6447+3:2403:x1876025572223488:12345-192.168.204.30@tcp:39:umount.0 Request processed in 1360us (1656us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789117999.733224:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 79 00000100:00100000:3.0:1789117999.766004:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789117999.767302:0:17791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572223744 00000100:00100000:2.0:1789117999.767320:0:17791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572223744 00000100:00100000:2.0:1789117999.767426:0:17791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 180 00000100:00100000:2.0:1789117999.767438:0:17791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+7:2403:x1876025572223744:12345-192.168.204.30@tcp:251:umount.0 00000020:00000080:2.0:1789117999.767505:0:17791:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20fd1 00000020:00010000:2.0:1789117999.767517:0:17791:0:(genops.c:1921:obd_stale_export_put()) Put export ffff962a81e47800: total 0 00000100:00080000:2.0:1789117999.767524:0:17791:0:(import.c:65:import_set_state_nolock()) ffff962a81e46800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789117999.767640:0:17791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b49ad67d-7c33-42bd-82d9-5cd0df812c7c+3:2403:x1876025572223744:12345-192.168.204.30@tcp:251:umount.0 Request processed in 205us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789117999.767649:0:17791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 180 00000020:00010000:1.0:1789117999.767968:0:18557:0:(genops.c:1907:obd_stale_export_get()) Get export ffff962a81e47800: total 0 00010000:00010000:1.0:1789117999.767983:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117999.768110:0:18557:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff962a81e47800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789117999.768164:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a88d9bc00/0xaa253ed19be20fd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f20f expref: 2 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789117999.768180:0:18557:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff962a81e47800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789117999.768191:0:18557:0:(genops.c:885:class_export_put()) final put ffff962a81e47800/b49ad67d-7c33-42bd-82d9-5cd0df812c7c 00010000:00010000:1.0:1789117999.768207:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117999.768209:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789117999.768210:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789117999.768571:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a81e47800/b49ad67d-7c33-42bd-82d9-5cd0df812c7c for MGS 00000020:00000080:3.0:1789117999.768633:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a81e46800 for MGS 00010000:00010000:3.0:1789118000.101618:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789118000.998536:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789118000.998568:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593291008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789118000.998753:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118000.998882:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593291008 00000100:00100000:3.0:1789118000.998892:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593291008 00000100:00100000:3.0:1789118000.998980:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789118000.998991:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593291008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789118000.999086:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789118000.999158:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593291008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 169us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118000.999167:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1789118000.999566:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789118001.001040:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593291008:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789118001.126699:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789118002.027016:0:21383:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789118002.069917:0:21383:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789118002.070012:0:21383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.070031:0:21383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.070040:0:21383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.070048:0:21383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.070453:0:21383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789118002.070460:0:21383:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789118002.070496:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789118002.070502:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789118002.070510:0:21383:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789118002.070551:0:21383:0:(import.c:65:import_set_state_nolock()) ffff962b9057d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789118002.070618:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593291136:0@lo:39:umount.0 00000100:00100000:0.0:1789118002.070729:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118002.070930:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593291136 00000100:00100000:2.0:1789118002.070939:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593291136 00000100:00100000:2.0:1789118002.071023:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789118002.071035:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876025593291136:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789118002.071090:0:17798:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20bc5 00000100:00080000:2.0:1789118002.071101:0:17798:0:(import.c:65:import_set_state_nolock()) ffff962bbf97d800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789118002.074617:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789118002.074640:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118002.074656:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f5000 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789118002.074661:0:18557:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118002.074675:0:18557:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789118002.074682:0:18557:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118002.074722:0:18557:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789118002.074726:0:18557:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789118002.074732:0:18557:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789118002.075254:0:18557:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.075266:0:18557:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789118002.075318:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.075326:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bc20f5000/0xaa253ed19be20b94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20b9b expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.075350:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118002.075352:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118002.075354:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118002.075509:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118002.075574:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf726580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593291264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789118002.075649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118002.075797:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593291264 00000100:00100000:1.0:1789118002.075807:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593291264 00000100:00100000:1.0:1789118002.075900:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789118002.075914:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81e7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3647:x1876025593291264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789118002.075936:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789118002.075963:0:17785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bc20f4200/0xaa253ed19be20b9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be20b94 expref: 24 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118002.075983:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789118002.076030:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81e7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+23:3647:x1876025593291264:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118002.076040:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789118002.076157:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf726580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593291264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789118002.076580:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1876025593291136:12345-0@lo:39:umount.0 Request processed in 5544us (5847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118002.076593:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:3.0:1789118002.076606:0:17798:0:(genops.c:885:class_export_put()) final put ffff962bbf97f800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1789118002.076701:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b9057d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789118002.076718:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593291136:0@lo:39:umount.0 00000100:00080000:3.0:1789118002.076764:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789118002.076787:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789118002.076794:0:21383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789118002.078414:0:21383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.078436:0:21383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.078444:0:21383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.078452:0:21383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.078485:0:21383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789118002.078493:0:21383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.078508:0:21383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.078513:0:21383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.078520:0:21383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.078601:0:21383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789118002.078610:0:21383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.078617:0:21383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.078623:0:21383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.078630:0:21383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118002.078705:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789118002.078716:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118002.078736:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80030a00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789118002.078740:0:18557:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118002.078750:0:18557:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789118002.078758:0:18557:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789118002.078878:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf97f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 10000000:01000000:2.0:1789118002.078965:0:18557:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789118002.078970:0:18557:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789118002.079021:0:18557:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118002.079029:0:18557:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789118002.079144:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593291392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789118002.079240:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789118002.079349:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118002.079358:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b80030a00/0xaa253ed19be20ae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20aec expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118002.079378:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789118002.079382:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118002.079388:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92600 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789118002.079392:0:18557:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118002.079412:0:18557:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789118002.079418:0:18557:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789118002.079424:0:18557:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789118002.079427:0:18557:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789118002.079431:0:18557:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789118002.079451:0:18557:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118002.079456:0:18557:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789118002.079527:0:21383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789118002.079536:0:21383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.079543:0:21383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.079559:0:21383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.079566:0:21383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118002.079574:0:21383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789118002.079577:0:21383:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789118002.079581:0:21383:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789118002.079624:0:21383:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789118002.079629:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789118002.079634:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789118002.079641:0:21383:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/15 00000020:00080000:3.0:1789118002.079647:0:21383:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff962a86ccf000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789118002.079653:0:21383:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff962bbd04c800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789118002.079656:0:21383:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff962bbd04e000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789118002.079661:0:21383:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff962b9057c000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789118002.079669:0:21383:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff962a86cc0800 3a40d558-cfad-4484-8c6e-52e7fbfb6447 192.168.204.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1789118002.079674:0:21383:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff962a86cce800 369a8077-26bb-4780-baf3-16abc59c8ae5 192.168.204.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:3.0:1789118002.079680:0:21383:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff962a878ab490) has exports, disconnecting them 00000020:00080000:3.0:1789118002.079685:0:21383:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff962a86ccf000), last request at 1789117997 00000020:00000080:3.0:1789118002.079695:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20ec7 00000100:00080000:3.0:1789118002.079715:0:21383:0:(import.c:65:import_set_state_nolock()) ffff962a86ccb000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789118002.079789:0:21383:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962a86ccf000): rc 0 00000020:00000080:3.0:1789118002.079792:0:21383:0:(genops.c:885:class_export_put()) final put ffff962a86ccf000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789118002.079810:0:21383:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff962bbd04c800), last request at 1789117997 00000020:00000080:3.0:1789118002.079814:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20d62 00000100:00080000:3.0:1789118002.079822:0:21383:0:(import.c:65:import_set_state_nolock()) ffff962a86a7e000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789118002.079831:0:21383:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962bbd04c800): rc 0 00000020:00000080:3.0:1789118002.079833:0:21383:0:(genops.c:885:class_export_put()) final put ffff962bbd04c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789118002.079838:0:21383:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff962bbd04e000), last request at 1789117910 00000020:00000080:3.0:1789118002.079841:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20cb3 00000100:00080000:3.0:1789118002.079845:0:21383:0:(import.c:65:import_set_state_nolock()) ffff962bbd048000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789118002.079851:0:21383:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962bbd04e000): rc 0 00000020:00000080:3.0:1789118002.079853:0:21383:0:(genops.c:885:class_export_put()) final put ffff962bbd04e000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1789118002.079857:0:21383:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff962b9057c000), last request at 1789117909 00000020:00000080:3.0:1789118002.079860:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20c4a 00000100:00080000:3.0:1789118002.079863:0:21383:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789118002.079871:0:21383:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00080000:3.0:1789118002.079969:0:21383:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962b9057c000): rc 0 00000004:00000080:3.0:1789118002.079977:0:21383:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc5cc82f7ae0 00000100:00080000:3.0:1789118002.080004:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789118002.080007:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789118002.080928:0:21383:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789118002.080964:0:21383:0:(import.c:65:import_set_state_nolock()) ffff962bae4d5000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789118002.082956:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789118002.082995:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593291520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789118002.083146:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789118002.083264:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789118002.083279:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118002.083323:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789118002.083328:0:17787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118002.083341:0:17787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789118002.083348:0:17787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118002.083355:0:17787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789118002.083358:0:17787:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789118002.083362:0:17787:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789118002.083411:0:17787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118002.083417:0:17787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789118002.083451:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118002.083459:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbbc10800/0xaa253ed19be2109c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be210a3 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118002.083480:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789118002.083485:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118002.083491:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789118002.083495:0:17787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118002.083510:0:17787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789118002.083516:0:17787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118002.083521:0:17787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789118002.083523:0:17787:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789118002.083526:0:17787:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789118002.083540:0:17787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118002.083545:0:17787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789118002.083551:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118002.083557:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a887f2800/0xaa253ed19be20ad7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20ade expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118002.083567:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118002.083568:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118002.083570:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789118002.083598:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593291392 00000100:00100000:1.0:1789118002.083608:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593291392 00000100:00100000:1.0:1789118002.083676:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593291520 00000100:00100000:1.0:1789118002.083680:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593291520 00000100:00100000:1.0:1789118002.083701:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789118002.083714:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed78b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+24:3644:x1876025593291392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789118002.083732:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789118002.083759:0:17785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813da800/0xaa253ed19be20aec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be20ae5 expref: 24 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118002.084144:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118002.084154:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a87d92600/0xaa253ed19be20ef8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20eff expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118002.084169:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118002.084172:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118002.084174:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789118002.084233:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbf97d800 for lustre-MDT0000 00000020:00000080:2.0:1789118002.084242:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a86ccf000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789118002.084289:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbd04c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789118002.084318:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbd04e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789118002.084341:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a86ccb000 for lustre-MDT0000 00000020:00000080:2.0:1789118002.084345:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a86a7e000 for lustre-MDT0000 00000020:00000080:2.0:1789118002.084351:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbd048000 for lustre-MDT0000 00010000:00010000:1.0:1789118002.084485:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789118002.084588:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed78b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+23:3644:x1876025593291392:12345-0@lo:103:ldlm_bl.0 Request processed in 873us (5346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118002.084600:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789118002.084634:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789118002.084644:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed78f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+22:3644:x1876025593291520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789118002.084654:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789118002.084667:0:17785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92e00/0xaa253ed19be20eff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be20ef8 expref: 22 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118002.084676:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789118002.084699:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed78f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+21:3644:x1876025593291520:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118002.084706:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789118002.084738:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593291776:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789118002.085539:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789118002.085553:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1789118002.085578:0:21383:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789118002.085686:0:21383:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:0.0:1789118002.086133:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118002.086173:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf726d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593291648:0@lo:39:umount.0 00000100:00080000:2.0:1789118002.086312:0:21383:0:(import.c:65:import_set_state_nolock()) ffff962bae4d8800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789118002.086329:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789118002.086332:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1789118002.086348:0:21383:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789118002.086409:0:21383:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789118002.086421:0:21383:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789118002.086479:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff962a878ab490) has no exports 00000100:00100000:2.0:1789118002.089996:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593291520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789118002.090019:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593291392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789118002.090111:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593291904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789118002.090379:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118002.090431:0:17803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593291648 00000100:00100000:0.0:1789118002.090440:0:17803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593291648 00000100:00100000:0.0:1789118002.090506:0:17803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789118002.090517:0:17803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876025593291648:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789118002.090559:0:17803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20cdd 00000100:00080000:0.0:1789118002.090570:0:17803:0:(import.c:65:import_set_state_nolock()) ffff962bbcfe9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789118002.090605:0:17803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:3.0:1789118002.090625:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118002.090868:0:17803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3643:x1876025593291648:12345-0@lo:39:umount.0 Request processed in 350us (489us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789118002.090878:0:17803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1789118002.090926:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bae4d5000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789118002.090935:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf726d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593291648:0@lo:39:umount.0 00000100:00100000:0.0:1789118002.090951:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593292032:0@lo:9:umount.0 00000100:00100000:0.0:1789118002.090983:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118002.091011:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593292032 00000100:00100000:0.0:1789118002.091015:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593292032 00000100:00100000:0.0:1789118002.091096:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789118002.091104:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876025593292032:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789118002.091122:0:19313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20da8 00000100:00080000:0.0:1789118002.091153:0:19313:0:(import.c:65:import_set_state_nolock()) ffff962a87d61000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789118002.091192:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1789118002.091205:0:19313:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1789118002.091302:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3643:x1876025593292032:12345-0@lo:9:umount.0 Request processed in 200us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118002.091310:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1789118002.091329:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789118002.091343:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bae4d8800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789118002.091366:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789118002.091369:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789118002.091372:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593292032:0@lo:9:umount.0 00000100:00100000:0.0:1789118002.091379:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593292160:0@lo:9:umount.0 00000100:00100000:0.0:1789118002.091401:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118002.091422:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593292160 00000100:00100000:0.0:1789118002.091425:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593292160 00000100:00100000:0.0:1789118002.091453:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789118002.091459:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eeded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876025593292160:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789118002.091471:0:19311:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20f06 00000100:00080000:0.0:1789118002.091477:0:19311:0:(import.c:65:import_set_state_nolock()) ffff962a88d4d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789118002.091515:0:19311:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789118002.091598:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eeded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3643:x1876025593292160:12345-0@lo:9:umount.0 Request processed in 139us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118002.091604:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1789118002.091620:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789118002.091632:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b853e0000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789118002.091640:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789118002.091642:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789118002.091644:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593292160:0@lo:9:umount.0 00000100:00080000:3.0:1789118002.095021:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789118002.095305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118002.095570:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593291776 00000100:00100000:0.0:1789118002.095604:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593291776 00000100:00100000:0.0:1789118002.095690:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789118002.095701:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed7b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+21:3646:x1876025593291776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789118002.095736:0:17785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789118002.095764:0:17785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92a00/0xaa253ed19be210a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be2109c expref: 21 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118002.095795:0:17785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789118002.095865:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed7b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf05977c-16b5-4df3-81bb-3835e509f77c+20:3646:x1876025593291776:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118002.095873:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789118002.096227:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593291776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789118002.096686:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118002.096919:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593291904 00000100:00100000:2.0:1789118002.096928:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593291904 00000100:00100000:2.0:1789118002.097026:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789118002.097036:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+20:3647:x1876025593291904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789118002.097094:0:17783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789118002.097116:0:17783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bc20f4a00/0xaa253ed19be20ade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be20ad7 expref: 20 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118002.097139:0:17783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789118002.097190:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf05977c-16b5-4df3-81bb-3835e509f77c+19:3647:x1876025593291904:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118002.097199:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789118002.097290:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593291904:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789118002.104376:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff962a878ab490) has no exports 00000020:00000080:0.0:1789118002.175002:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20b32 00000020:00000080:0.0:1789118002.175020:0:21383:0:(genops.c:885:class_export_put()) final put ffff962b872f0800/lustre-QMT0000_UUID 00000020:01000000:0.0:1789118002.175043:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789118002.175123:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962b872f0800/lustre-QMT0000_UUID for lustre-QMT0000 00010000:00010000:1.0:1789118002.176266:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789118002.181023:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789118002.181049:0:21383:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789118002.181069:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff962bb0828000) has no exports 00000020:00000080:2.0:1789118002.182205:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20b2b 00000020:00000080:2.0:1789118002.182221:0:21383:0:(genops.c:885:class_export_put()) final put ffff962bb5c48000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789118002.182310:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789118002.182323:0:21383:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789118002.182327:0:21383:0:(genops.c:885:class_export_put()) final put ffff962bb5c4d000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789118002.182330:0:21383:0:(genops.c:844:class_export_destroy()) destroying export ffff962bb5c4d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789118002.182336:0:21383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1789118002.183422:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bb5c48000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000040:00080000:0.0:1789118002.213808:0:18556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789118002.535591:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789118002.535643:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593292288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789118002.535809:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118002.542456:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593292288 00000100:00100000:3.0:1789118002.542484:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593292288 00000100:00100000:3.0:1789118002.542683:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789118002.542700:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1876025593292288:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1789118002.542714:0:17804:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789118002.542945:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1876025593292288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 246us (7134us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789118002.542954:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:02020000:1.0:1789118002.543109:0:3645:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1789118002.561269:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789118002.561279:0:3645:0:(import.c:65:import_set_state_nolock()) ffff962bbf326800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789118002.561285:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789118002.574515:0:3645:0:(import.c:65:import_set_state_nolock()) ffff962bbf326800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789118002.574531:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 562 00000100:00080000:1.0:1789118002.574544:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff962bbf326800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789118002.574608:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b8ed78000 x1876025593292416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789118002.575408:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593292416:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789118002.575521:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118002.575905:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593292416 00000100:00100000:1.0:1789118002.575919:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593292416 00000100:00100000:1.0:1789118002.575975:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789118002.575983:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876025593292416:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789118002.576005:0:18751:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789118002.588138:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876025593292416:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 12143us (12607us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789118002.588157:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789118002.588557:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf326800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789118002.588563:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789118002.588567:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593292416:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789118003.045417:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789118003.045443:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593292544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789118003.045522:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118003.046131:0:19315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593292544 00000100:00100000:3.0:1789118003.046146:0:19315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593292544 00000100:00100000:3.0:1789118003.046247:0:19315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789118003.046259:0:19315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a33840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593292544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789118003.046306:0:19315:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00080000:1.0:1789118003.046490:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789118003.046496:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789118003.046502:0:37:0:(import.c:65:import_set_state_nolock()) ffff962bbf326800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789118003.046510:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 654 00000100:00080000:1.0:1789118003.046516:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789118003.046524:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff962bbf326800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789118003.046560:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b8ed7bc00 x1876025593292800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789118003.046672:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593292928:0@lo:400:kworker.0 00000100:00100000:1.0:1789118003.046754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118003.046837:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593293440:0@lo:400:kworker.0 00000100:00100000:1.0:1789118003.046869:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118003.046925:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789118003.046931:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593292672:0@lo:400:kworker.0 00000100:00100000:1.0:1789118003.046969:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118003.047001:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593293312:0@lo:400:kworker.0 00000100:00100000:1.0:1789118003.047024:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118003.047085:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593293440 00000100:00100000:1.0:1789118003.047090:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593293440 00000100:00100000:1.0:1789118003.047140:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593293312 00000100:00100000:1.0:1789118003.047142:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593293312 00000100:00100000:1.0:1789118003.047169:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789118003.047177:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593293312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118003.047222:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876025593293312:12345-0@lo:400:kworker.0 Request processed in 46us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118003.047229:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789118003.047251:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789118003.047254:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1876025593293440:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789118003.047260:0:17800:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789118003.047283:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1876025593293440:12345-0@lo:400:kworker.0 Request processed in 27us (413us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789118003.047288:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789118003.047308:0:17793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593292672 00000100:00100000:1.0:1789118003.047311:0:17793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593292672 00000100:00100000:1.0:1789118003.047462:0:17793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789118003.047470:0:17793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b857aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+19:3647:x1876025593292672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118003.047503:0:17793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b857aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf05977c-16b5-4df3-81bb-3835e509f77c+19:3647:x1876025593292672:12345-0@lo:400:kworker.0 Request processed in 34us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118003.047509:0:17793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789118003.047579:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593292672:0@lo:400:kworker.0 00010000:00080000:1.0:1789118003.047592:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8ed78780 x1876025593293312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118003.047604:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876025593293312:0@lo:400:kworker.0 00000100:00080000:1.0:1789118003.047615:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789118003.047621:0:3647:0:(import.c:65:import_set_state_nolock()) ffff962a81e47000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789118003.047625:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789118003.047632:0:3647:0:(import.c:65:import_set_state_nolock()) ffff962a81e47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789118003.047635:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 603 00000100:00080000:1.0:1789118003.047640:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff962a81e47000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789118003.047665:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b8ed783c0 x1876025593293696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789118003.047679:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876025593293440:0@lo:400:kworker.0 00000100:00100000:1.0:1789118003.047712:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593293184:0@lo:400:kworker.0 00000100:00100000:1.0:1789118003.047742:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118003.047779:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593293184 00000100:00100000:1.0:1789118003.047783:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593293184 00000100:00100000:1.0:1789118003.047805:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789118003.047809:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1876025593293184:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789118003.047814:0:17800:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789118003.047837:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1876025593293184:12345-0@lo:400:kworker.0 Request processed in 28us (96us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789118003.047842:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1789118003.047865:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789118003.047887:0:3645:0:(import.c:65:import_set_state_nolock()) ffff962b84784000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789118003.047891:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789118003.047894:0:3645:0:(import.c:65:import_set_state_nolock()) ffff962b84784000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789118003.047897:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 583 00000100:00080000:1.0:1789118003.047902:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff962b84784000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789118003.047915:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b8ed78780 x1876025593293824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789118003.047926:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876025593293184:0@lo:400:kworker.0 00000100:00100000:1.0:1789118003.047942:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789118003.047948:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593293056:0@lo:400:kworker.0 00000100:00100000:1.0:1789118003.047971:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118003.047988:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593293056 00000100:00100000:1.0:1789118003.047991:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593293056 00000100:00100000:1.0:1789118003.048007:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789118003.048011:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1876025593293056:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789118003.048016:0:17800:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789118003.048036:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1876025593293056:12345-0@lo:400:kworker.0 Request processed in 24us (64us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789118003.048041:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1789118003.048090:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789118003.048093:0:3645:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789118003.048096:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789118003.048099:0:3645:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789118003.048102:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 562 00000100:00080000:1.0:1789118003.048116:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff962bbf4b2000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789118003.048128:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b8ed7a580 x1876025593293952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789118003.048139:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593293056:0@lo:400:kworker.0 00000100:00100000:1.0:1789118003.048146:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593293568:0@lo:400:kworker.0 00000100:00100000:1.0:1789118003.048173:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118003.048193:0:17800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593293568 00000100:00100000:1.0:1789118003.048196:0:17800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593293568 00000100:00100000:1.0:1789118003.048230:0:17800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789118003.048237:0:17800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593293568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118003.048271:0:17800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593293568:12345-0@lo:400:kworker.0 Request processed in 35us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118003.048277:0:17800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:1.0:1789118003.048301:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8ed79a40 x1876025593293568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118003.048311:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593293568:0@lo:400:kworker.0 00000100:00080000:0.0:1789118003.049008:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789118003.049017:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789118003.049041:0:19313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593292928 00000100:00100000:0.0:1789118003.049048:0:19313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593292928 00000100:00100000:0.0:1789118003.049160:0:19313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789118003.049174:0:19313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593292928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118003.049211:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593292800:0@lo:38:kworker.0 00000100:00100000:0.0:1789118003.049287:0:19313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593292928:12345-0@lo:400:kworker.0 Request processed in 116us (2531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118003.049317:0:19313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789118003.049347:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789118003.049370:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789118003.049423:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593292928:0@lo:400:kworker.0 00000100:00100000:2.0:1789118003.049425:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593293696:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1789118003.049466:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118003.049500:0:17804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593292800 00000100:00100000:0.0:1789118003.049506:0:17804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593292800 00000100:00100000:2.0:1789118003.049508:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593293824:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789118003.049544:0:17804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789118003.049555:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118003.049562:0:17804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876025593292800:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789118003.049586:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876025593293952:0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1789118003.049587:0:17804:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789118003.049646:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118003.049655:0:17804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876025593292800:12345-0@lo:38:kworker.0 Request processed in 95us (309us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789118003.049667:0:17804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789118003.049701:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593293696 00000100:00100000:0.0:1789118003.049706:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593293696 00000100:00100000:0.0:1789118003.049729:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593293824 00000100:00100000:0.0:1789118003.049732:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593293824 00000100:00100000:0.0:1789118003.049743:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593293952 00000100:00100000:0.0:1789118003.049747:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593293952 00000100:00080000:2.0:1789118003.049750:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf326800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789118003.049770:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789118003.056293:0:19315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a33840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593292544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3741us (4476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118003.056511:0:19315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789118003.057393:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789118003.057418:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876025593293696:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1789118003.057452:0:20601:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789118003.057603:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876025593293696:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 190us (8135us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789118003.057831:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789118003.057841:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593293824:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789118003.057852:0:17798:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789118003.057899:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593293824:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 58us (8353us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789118003.057907:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789118003.057951:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789118003.057956:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593293952:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789118003.057964:0:17798:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789118003.058009:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593293952:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 51us (8365us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789118003.058016:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789118003.058176:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593292544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789118003.059732:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789118003.061152:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593292800:0@lo:38:kworker.0 00000100:00080000:2.0:1789118003.061225:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a81e47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789118003.061232:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789118003.061237:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593293696:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1789118003.061268:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b84784000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789118003.061273:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789118003.061276:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593293824:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1789118003.061493:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789118003.061497:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789118003.061500:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876025593293952:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1789118003.238372:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789118003.560001:0:19307:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789118003.560010:0:19307:0:(genops.c:885:class_export_put()) final put ffff962a87d64800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789118003.560039:0:19307:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 369a8077-26bb-4780-baf3-16abc59c8ae5 00000020:00000080:3.0:1789118003.560042:0:19307:0:(genops.c:885:class_export_put()) final put ffff962a86a78000/369a8077-26bb-4780-baf3-16abc59c8ae5 00000020:00000080:2.0:1789118003.560116:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87d64800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789118003.560179:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a86a78000/369a8077-26bb-4780-baf3-16abc59c8ae5 for lustre-OST0000 00000020:00000080:2.0:1789118003.560200:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87d61000 for lustre-OST0000 00000020:00000080:2.0:1789118003.560205:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a86a7d000 for lustre-OST0000 00000001:00100000:2.0:1789118003.566683:0:17778:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789118003.566693:0:17778:0:(genops.c:885:class_export_put()) final put ffff962b9057c000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789118003.566725:0:17778:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3a40d558-cfad-4484-8c6e-52e7fbfb6447 00000001:00080000:2.0:1789118003.566737:0:17778:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:2.0:1789118003.566741:0:17778:0:(genops.c:885:class_export_put()) final put ffff962a86cc0800/3a40d558-cfad-4484-8c6e-52e7fbfb6447 00000001:00100000:2.0:1789118003.566747:0:17778:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 369a8077-26bb-4780-baf3-16abc59c8ae5 00000001:00080000:2.0:1789118003.566761:0:17778:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:2.0:1789118003.566763:0:17778:0:(genops.c:885:class_export_put()) final put ffff962a86cce800/369a8077-26bb-4780-baf3-16abc59c8ae5 00000020:00000080:0.0:1789118003.566848:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962b9057c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1789118003.566913:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a86cc0800/3a40d558-cfad-4484-8c6e-52e7fbfb6447 for lustre-MDT0000 00000020:00000080:0.0:1789118003.566938:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a86cce800/369a8077-26bb-4780-baf3-16abc59c8ae5 for lustre-MDT0000 00000020:00000080:0.0:1789118003.566964:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbf4b3000 for lustre-MDT0000 00000020:00000080:0.0:1789118003.566975:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a86cc0000 for lustre-MDT0000 00000020:00000080:0.0:1789118003.566978:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a86cc8000 for lustre-MDT0000 00000001:00100000:1.0:1789118003.567327:0:18534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789118003.567335:0:18534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1789118003.567339:0:18534:0:(genops.c:885:class_export_put()) final put ffff962bae85d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789118003.567356:0:18534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3a40d558-cfad-4484-8c6e-52e7fbfb6447 00000001:00080000:1.0:1789118003.567363:0:18534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1789118003.567365:0:18534:0:(genops.c:885:class_export_put()) final put ffff962a885d1800/3a40d558-cfad-4484-8c6e-52e7fbfb6447 00000001:00100000:1.0:1789118003.567370:0:18534:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 369a8077-26bb-4780-baf3-16abc59c8ae5 00000001:00080000:1.0:1789118003.567374:0:18534:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1789118003.567376:0:18534:0:(genops.c:885:class_export_put()) final put ffff962a86a7e800/369a8077-26bb-4780-baf3-16abc59c8ae5 00000020:00000080:0.0:1789118003.567423:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962bae85d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789118003.567458:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a885d1800/3a40d558-cfad-4484-8c6e-52e7fbfb6447 for lustre-MDT0001 00000020:00000080:0.0:1789118003.567481:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a86a7e800/369a8077-26bb-4780-baf3-16abc59c8ae5 for lustre-MDT0001 00000020:00000080:0.0:1789118003.567508:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbcfe9000 for lustre-MDT0001 00000020:00000080:0.0:1789118003.567512:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a885d2000 for lustre-MDT0001 00000020:00000080:0.0:1789118003.567515:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a86a7a800 for lustre-MDT0001 00000020:01000000:2.0:1789118004.197601:0:21383:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962bae4e9480 - data ffff962a860dc510/ffff962bb02fb000 00000020:01000000:2.0:1789118004.197795:0:21383:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962a87ceba20 - data ffff962b9105b6c0/ffff962b84453400 00000001:00000004:2.0:1789118004.207982:0:21383:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00010000:00010000:1.0:1789118004.261264:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789118004.269593:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789118004.269608:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789118004.269628:0:21383:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff962bbf726d00 x1876025593291648/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789118012 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118004.269673:0:21383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789118004.271810:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789118004.271818:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1789118004.271839:0:21383:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789118004.271842:0:21383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789118004.272080:0:17822:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789118004.272086:0:17822:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:2.0:1789118004.272098:0:17822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1789118004.273426:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789118004.273432:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1789118004.273493:0:21383:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789118004.273496:0:21383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789118004.276081:0:17824:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789118004.276091:0:17824:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:3.0:1789118004.276129:0:17824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1789118004.278166:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20afa 00000020:00000080:1.0:1789118004.278183:0:21383:0:(genops.c:885:class_export_put()) final put ffff962ba19da000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789118004.278772:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962ba19da000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789118004.280573:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20b0f 00000020:00000080:1.0:1789118004.280590:0:21383:0:(genops.c:885:class_export_put()) final put ffff962b853e4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789118004.280622:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789118004.280627:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789118004.280642:0:21383:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789118004.280647:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff962a878aced8) has no exports 00000004:01000000:1.0:1789118004.280833:0:21383:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789118004.280841:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20b71 00000020:00000080:1.0:1789118004.280845:0:21383:0:(genops.c:885:class_export_put()) final put ffff962bae4dd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789118004.280849:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789118004.280853:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789118004.280858:0:21383:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789118004.280860:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff962bb082ced8) has no exports 00000020:00000080:1.0:1789118004.280866:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20b6a 00000020:00000080:1.0:1789118004.280869:0:21383:0:(genops.c:885:class_export_put()) final put ffff962b853e5800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789118004.280974:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962b853e4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789118004.280987:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bae4dd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789118004.280995:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962b853e5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789118004.281851:0:21383:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789118004.281857:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789118004.281862:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1789118004.281869:0:21383:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789118004.281871:0:21383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789118004.281905:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789118004.281912:0:21383:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789118004.281919:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20b5c 00000020:00000080:1.0:1789118004.281926:0:21383:0:(genops.c:885:class_export_put()) final put ffff962bae4d7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789118004.281931:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789118004.281935:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789118004.281938:0:21383:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789118004.281940:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff962bbcdd8000) has no exports 00000020:00000080:1.0:1789118004.281945:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20b55 00000020:00000080:1.0:1789118004.281948:0:21383:0:(genops.c:885:class_export_put()) final put ffff962bae4de800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789118004.282978:0:21383:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000020:00000080:2.0:1789118004.282979:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962b853e0000 for lustre-OST0001-osc-MDT0000 00000100:00080000:1.0:1789118004.282987:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000020:00000080:2.0:1789118004.282995:0:37:0:(genops.c:885:class_export_put()) final put ffff962bae4d3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789118004.282999:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bae4d3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000100:00100000:1.0:1789118004.283007:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000020:01000000:2.0:1789118004.283008:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:00080000:1.0:1789118004.283016:0:21383:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789118004.283019:0:21383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789118004.283103:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789118004.283112:0:21383:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789118004.283131:0:21383:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789118004.283139:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20b47 00000020:00000080:1.0:1789118004.283147:0:21383:0:(genops.c:885:class_export_put()) final put ffff962b853e7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789118004.283165:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1789118004.283168:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bae4d7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789118004.283170:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789118004.283177:0:21383:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:2.0:1789118004.283179:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bae4de800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1789118004.283181:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff962a878a8000) has no exports 00000020:00000080:2.0:1789118004.283186:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bae4d8800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789118004.283188:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20b40 00000020:00000080:1.0:1789118004.283193:0:21383:0:(genops.c:885:class_export_put()) final put ffff962bae4d5800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789118004.283194:0:37:0:(genops.c:885:class_export_put()) final put ffff962b853e1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789118004.283198:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962b853e1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789118004.283201:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789118004.283232:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962b853e7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789118004.283240:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bae4d5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789118004.289806:0:21383:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1789118004.289816:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789118004.289822:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789118004.289831:0:21383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789118004.289900:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789118004.289913:0:21383:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789118004.289941:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789118004.289944:0:21383:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789118004.289951:0:21383:0:(genops.c:885:class_export_put()) final put ffff962bbf874000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789118004.289956:0:21383:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf874000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789118004.289966:0:21383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789118004.290121:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20b16 00000020:00000080:3.0:1789118004.290129:0:21383:0:(genops.c:885:class_export_put()) final put ffff962b853e3000/lustre-MDD0000_UUID 00000020:01000000:3.0:1789118004.290134:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789118004.290138:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789118004.290143:0:21383:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789118004.290146:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff962a878a9a48) has no exports 00000020:00000080:3.0:1789118004.290164:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789118004.290166:0:21383:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789118004.290170:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20b1d 00000020:00000080:3.0:1789118004.290183:0:21383:0:(genops.c:885:class_export_put()) final put ffff962b853e6800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789118004.290193:0:21383:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962a88713800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789118004.290196:0:21383:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962a88713800 3 00000020:01000004:3.0:1789118004.290200:0:21383:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff962a88713800 from lustre-MDT0000 00000020:00000080:3.0:1789118004.290219:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789118004.290222:0:21383:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789118004.290225:0:21383:0:(genops.c:885:class_export_put()) final put ffff962bbf873800/lustre-MDT0000_UUID 00000020:00000080:3.0:1789118004.290227:0:21383:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf873800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789118004.290232:0:21383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789118004.290262:0:21383:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1789118004.290267:0:21383:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789118004.290269:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789118004.290271:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789118004.290274:0:21383:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789118004.290280:0:21383:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff962bb5c81000 bf05977c-16b5-4df3-81bb-3835e509f77c 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789118004.290286:0:21383:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff962bbfacb490) has exports, disconnecting them 00000020:00080000:3.0:1789118004.290290:0:21383:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff962bb5c81000), last request at 1789117891 00000020:00000080:3.0:1789118004.290306:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20ac2 00000020:00010000:3.0:1789118004.290310:0:21383:0:(genops.c:1921:obd_stale_export_put()) Put export ffff962bb5c81000: total 2 00000100:00080000:3.0:1789118004.290314:0:21383:0:(import.c:65:import_set_state_nolock()) ffff962bb5c82800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789118004.290324:0:21383:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962bb5c81000): rc 0 00000020:00080000:3.0:1789118004.290328:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff962bbfacb490) has no exports 00000100:00100000:3.0:1789118004.290406:0:17791:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff962bae6fd200:17791] 1 exiting: rc = 0 00000020:00010000:1.0:1789118004.291529:0:17787:0:(genops.c:1907:obd_stale_export_get()) Get export ffff962bb5c81000: total 2 00010000:00010000:1.0:1789118004.291588:0:17787:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff962bb5c81000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789118004.291624:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbbc10600/0xaa253ed19be21095 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be2108e expref: 14 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118004.291647:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d93400/0xaa253ed19be20e88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be20e81 expref: 13 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118004.291659:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d93e00/0xaa253ed19be20eb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be20eab expref: 12 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118004.291669:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a88d9ac00/0xaa253ed19be20ef1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be20eea expref: 11 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118004.291683:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813dbe00/0xaa253ed19be20d23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be20d1c expref: 10 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118004.291692:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bc20f5e00/0xaa253ed19be20be1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be20bda expref: 9 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118004.291716:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962baea9b200/0xaa253ed19be20d4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be20d46 expref: 8 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118004.291727:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a88d9a200/0xaa253ed19be21079 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be21072 expref: 7 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118004.291749:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813daa00/0xaa253ed19be20c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be20c97 expref: 6 pid: 17790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118004.291762:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813dae00/0xaa253ed19be20bef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be20be8 expref: 5 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118004.292548:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbbc11a00/0xaa253ed19be21087 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be21080 expref: 4 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118004.292568:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813db600/0xaa253ed19be20bfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be20bf6 expref: 3 pid: 17793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118004.292587:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bc20f4c00/0xaa253ed19be20ad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa253ed19be20ac9 expref: 2 pid: 17791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118004.292602:0:17787:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff962bb5c81000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1789118004.292646:0:17787:0:(genops.c:885:class_export_put()) final put ffff962bb5c81000/bf05977c-16b5-4df3-81bb-3835e509f77c 00010000:00010000:1.0:1789118004.292664:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118004.292667:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118004.292669:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118004.292689:0:17793:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff962bbcfacc00:17793] 2 exiting: rc = 0 00000020:00000080:3.0:1789118004.292829:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bae4d5000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789118004.292842:0:36:0:(genops.c:885:class_export_put()) final put ffff962b853e7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789118004.292845:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962b853e7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1789118004.292853:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789118004.292939:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962b853e3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789118004.292944:0:36:0:(genops.c:885:class_export_put()) final put ffff962b853e3800/lustre-MDD0000_UUID 00000020:00000080:3.0:1789118004.292946:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962b853e3800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789118004.292949:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789118004.292978:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962b853e6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789118004.292983:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962bb5c81000/bf05977c-16b5-4df3-81bb-3835e509f77c for MGS 00000020:00000080:3.0:1789118004.293017:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bb5c82800 for MGS 00000100:00100000:1.0:1789118004.296196:0:17790:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff962bbcfade00:17790] 0 exiting: rc = 1 00000100:00100000:3.0:1789118004.299505:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299527:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299535:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299542:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299550:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299556:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299565:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299575:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299584:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299592:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299601:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299609:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299618:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299626:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299633:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299640:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299647:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299656:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299662:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299669:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299714:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299720:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299727:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299734:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299751:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299757:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299763:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299768:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299773:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299781:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299789:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299796:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299802:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299809:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299819:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299825:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299833:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299840:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299847:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299854:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299860:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299866:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299873:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299878:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299884:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299891:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299897:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299904:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299910:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299916:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299923:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299928:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299933:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299939:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299945:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299963:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299968:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299974:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299979:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299985:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299990:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.299995:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.300000:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118004.300008:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1789118004.305665:0:21383:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962a81722300 - data ffff962b9c8186c0/ffff962a87a23c00 00000020:01000000:3.0:1789118004.305844:0:21383:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962bc1bcf660 - data ffff962b9c9fb510/ffff962bbfd3cc00 00000020:00000080:3.0:1789118004.306377:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20aa6 00000020:00000080:3.0:1789118004.306387:0:21383:0:(genops.c:885:class_export_put()) final put ffff962b98329800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789118004.306411:0:21383:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962a88713800 from MGS, refs=2 00000020:01000004:3.0:1789118004.306415:0:21383:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962a88713800 2 00000020:01000004:3.0:1789118004.306418:0:21383:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff962a88713800 from MGS 00000020:00000080:3.0:1789118004.306441:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789118004.306454:0:21383:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789118004.306457:0:21383:0:(genops.c:885:class_export_put()) final put ffff962b9832e800/MGS 00000020:00000080:3.0:1789118004.306459:0:21383:0:(genops.c:844:class_export_destroy()) destroying export ffff962b9832e800/MGS for MGS 00000020:01000000:3.0:1789118004.306465:0:21383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1789118004.306497:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962b98329800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789118004.306535:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789118004.306539:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789118004.306544:0:21383:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789118004.306551:0:21383:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff962b9057f000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789118004.306555:0:21383:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff962bb082b490) has exports, disconnecting them 00000020:00080000:3.0:1789118004.306560:0:21383:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff962b9057f000), last request at 1789117892 00000020:00000080:3.0:1789118004.306564:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20ba9 00000020:00080000:3.0:1789118004.306573:0:21383:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962b9057f000): rc 0 00000020:00000080:3.0:1789118004.306577:0:21383:0:(genops.c:885:class_export_put()) final put ffff962b9057f000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789118004.306912:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962b9057f000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789118004.331162:0:21383:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789118004.331172:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789118004.331177:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789118004.331186:0:21383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789118004.331423:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789118004.331444:0:21383:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789118004.331453:0:21383:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962a88713800 1 00000020:00000080:2.0:1789118004.331463:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20a98 00000020:00000080:2.0:1789118004.331476:0:21383:0:(genops.c:885:class_export_put()) final put ffff962b9832d800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789118004.331483:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789118004.331489:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789118004.331494:0:21383:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789118004.331498:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff962bb0829a48) has no exports 00000020:00000080:1.0:1789118004.333613:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962b9057d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789118004.333633:0:37:0:(genops.c:885:class_export_put()) final put ffff962bbf877800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789118004.333638:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf877800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789118004.333655:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789118004.333762:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962b9832d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789118004.461338:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789118004.461352:0:21383:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789118004.461360:0:21383:0:(genops.c:885:class_export_put()) final put ffff962a88717000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789118004.461366:0:21383:0:(genops.c:844:class_export_destroy()) destroying export ffff962a88717000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789118004.461380:0:21383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789118004.461539:0:21383:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff962a88714000 00000020:02000400:1.0:1789118004.461616:0:21383:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789118005.285399:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118006.118505:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789118006.118534:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf725680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593294080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789118006.118609:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118006.119298:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593294080 00000100:00100000:3.0:1789118006.119312:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593294080 00000100:00100000:3.0:1789118006.119445:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789118006.119457:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593294080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789118006.119502:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789118006.119574:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593294080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118006.119582:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789118006.119644:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf725680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593294080:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789118006.119840:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789118006.309729:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118007.335302:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789118007.655391:0:20127:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789118007.655407:0:20127:0:(genops.c:885:class_export_put()) final put ffff962a88d49800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789118007.659997:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a88d49800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789118007.665271:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a88d4d800 for lustre-OST0001 00000100:00080000:0.0:1789118008.174901:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789118008.174911:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789118008.174916:0:37:0:(import.c:65:import_set_state_nolock()) ffff962bbf326800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789118008.174928:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 655 00000100:00080000:0.0:1789118008.174936:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789118008.174945:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff962bbf326800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789118008.174979:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87d9e1c0 x1876025593294464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789118008.175491:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593294208:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789118008.175514:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789118008.175517:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789118008.175519:0:37:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789118008.175523:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 655 00000100:00080000:0.0:1789118008.175545:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789118008.175550:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff962bbf4b2000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789118008.175564:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87d9f0c0 x1876025593294848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789118008.175573:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789118008.175576:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789118008.175578:0:37:0:(import.c:65:import_set_state_nolock()) ffff962b84784000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789118008.175581:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 655 00000100:00080000:0.0:1789118008.175583:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789118008.175587:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff962b84784000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789118008.175593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118008.175596:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87d9ed00 x1876025593294976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789118008.175611:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789118008.175615:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789118008.175617:0:37:0:(import.c:65:import_set_state_nolock()) ffff962a81e47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789118008.175621:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 655 00000100:00080000:0.0:1789118008.175623:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789118008.175626:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff962a81e47000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789118008.175637:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87d9c000 x1876025593295232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789118008.175693:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593294592:0@lo:400:kworker.0 00000100:00100000:1.0:1789118008.177808:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593294336:0@lo:400:kworker.0 00000100:00100000:2.0:1789118008.182747:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593295360:0@lo:400:kworker.0 00000100:00100000:2.0:1789118008.183452:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118008.184839:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593294464:0@lo:38:kworker.0 00000100:00100000:2.0:1789118008.184922:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118008.184962:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876025593294848:0@lo:38:kworker.0 00000100:00100000:2.0:1789118008.184994:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118008.185015:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593294976:0@lo:38:kworker.0 00000100:00100000:2.0:1789118008.185070:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118008.185094:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593295232:0@lo:38:kworker.0 00000100:00100000:2.0:1789118008.186560:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118008.186713:0:19314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593294208 00000100:00100000:2.0:1789118008.186726:0:19314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593294208 00000100:00100000:2.0:1789118008.186839:0:19314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789118008.186854:0:19314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593294208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789118008.186913:0:19314:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789118008.186991:0:19314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593294208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (11397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118008.187025:0:19314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789118008.187108:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593295360 00000100:00100000:2.0:1789118008.187114:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593295360 00000100:00100000:2.0:1789118008.187160:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593294848 00000100:00100000:2.0:1789118008.187164:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593294848 00000100:00100000:2.0:1789118008.187177:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593294976 00000100:00100000:2.0:1789118008.187180:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593294976 00000100:00100000:2.0:1789118008.187189:0:17798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593295232 00000100:00100000:2.0:1789118008.187191:0:17798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593295232 00000100:00100000:2.0:1789118008.187202:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789118008.187222:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593295360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118008.187269:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876025593295360:12345-0@lo:400:kworker.0 Request processed in 60us (3821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118008.187277:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789118008.187288:0:17798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789118008.187292:0:17798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593294848:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789118008.187320:0:17798:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789118008.190678:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593294464 00000100:00100000:1.0:1789118008.190710:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593294464 00000100:00100000:1.0:1789118008.192484:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789118008.192499:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876025593294464:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789118008.192531:0:18751:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789118008.192695:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876025593294464:12345-0@lo:38:kworker.0 Request processed in 197us (7771us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789118008.192705:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000400:00000100:1.0:1789118008.192863:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876025593294336 offset 0 length 224: 4 00000100:00100000:1.0:1789118008.192920:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593295104:0@lo:400:kworker.0 00000100:00100000:1.0:1789118008.192964:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118008.193039:0:20601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593295104 00000100:00100000:1.0:1789118008.193047:0:20601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593295104 00000100:00100000:1.0:1789118008.195679:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789118008.196865:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593295104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118008.197030:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593295104:12345-0@lo:400:kworker.0 Request processed in 1311us (4065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118008.197043:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789118008.198197:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789118008.198213:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876025593294976:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789118008.198242:0:20601:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789118008.198476:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876025593294976:12345-0@lo:38:kworker.0 Request processed in 265us (13436us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789118008.198485:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789118008.198531:0:20601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789118008.198537:0:20601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876025593295232:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789118008.198549:0:20601:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789118008.198577:0:20601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876025593295232:12345-0@lo:38:kworker.0 Request processed in 39us (12020us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789118008.198583:0:20601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789118008.198641:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593294720:0@lo:400:kworker.0 00000100:00100000:1.0:1789118008.200581:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789118008.202880:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff962a87d9da40 x1876025593295104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118008.202907:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593295104:0@lo:400:kworker.0 00000100:00100000:1.0:1789118008.203043:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593294720 00000100:00100000:1.0:1789118008.203078:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593294720 00000100:00100000:1.0:1789118008.205463:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789118008.205490:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81a0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593294720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118008.206568:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118008.207861:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81a0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593294720:12345-0@lo:400:kworker.0 Request processed in 2374us (7272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118008.207878:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789118008.207926:0:19311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593294592 00000100:00100000:1.0:1789118008.207937:0:19311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593294592 00000100:00100000:1.0:1789118008.209279:0:19311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789118008.209314:0:19311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593294592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118008.209459:0:19311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593294592:12345-0@lo:400:kworker.0 Request processed in 159us (2898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118008.209469:0:19311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789118008.209544:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593294720:0@lo:400:kworker.0 00000100:00100000:0.0:1789118008.209545:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593294592:0@lo:400:kworker.0 00000100:00080000:1.0:1789118008.210262:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789118008.210272:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789118008.210276:0:17794:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789118008.210503:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf326800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789118008.210512:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789118008.210519:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593294464:0@lo:38:kworker.0 00000100:00080000:1.0:1789118008.210538:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b84784000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789118008.210543:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789118008.210546:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593294976:0@lo:38:kworker.0 00000100:00080000:1.0:1789118008.210561:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a81e47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00080000:0.0:1789118008.210562:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff962a87d9f840 x1876025593295360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789118008.210566:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789118008.210569:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593295232:0@lo:38:kworker.0 00000100:00100000:0.0:1789118008.210602:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593295360:0@lo:400:kworker.0 00000100:00100000:0.0:1789118008.210643:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a32940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593294208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789118008.233121:0:17798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593294848:12345-0@lo:38:kworker.0 Request processed in 45804us (48103us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789118008.233151:0:17798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1789118008.233262:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789118008.233271:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789118008.233277:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876025593294848:0@lo:38:kworker.0 00010000:00010000:3.0:1789118008.357291:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789118008.946240:0:21584:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789118008.976966:0:21584:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1789118008.977030:0:21584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.977078:0:21584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.977086:0:21584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.977093:0:21584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.977118:0:21584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789118008.977124:0:21584:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789118008.977171:0:21584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789118008.977176:0:21584:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789118008.977184:0:21584:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789118008.977195:0:21584:0:(import.c:65:import_set_state_nolock()) ffff962bbf4b2000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789118008.977202:0:21584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789118008.977203:0:21584:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789118008.977207:0:21584:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789118008.978153:0:21584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978168:0:21584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978175:0:21584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978182:0:21584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978217:0:21584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789118008.978223:0:21584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978231:0:21584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978238:0:21584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978244:0:21584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978256:0:21584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789118008.978263:0:21584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978270:0:21584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978276:0:21584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978281:0:21584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978288:0:21584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789118008.978293:0:21584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978307:0:21584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978313:0:21584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978318:0:21584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118008.978325:0:21584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:1.0:1789118008.978328:0:21584:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1789118008.978355:0:21584:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1789118008.978359:0:21584:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1789118008.978363:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789118008.978368:0:21584:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1789118008.978375:0:21584:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff962a88d48800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789118008.978380:0:21584:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff962a87d62800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789118008.978385:0:21584:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff962bbcddced8) has exports, disconnecting them 00000020:00080000:1.0:1789118008.978390:0:21584:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff962a88d48800), last request at 1789118008 00000020:00000080:1.0:1789118008.978396:0:21584:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20edc 00000100:00080000:1.0:1789118008.978412:0:21584:0:(import.c:65:import_set_state_nolock()) ffff962a88d48000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789118008.978466:0:21584:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962a88d48800): rc 0 00000020:00000080:1.0:1789118008.978469:0:21584:0:(genops.c:885:class_export_put()) final put ffff962a88d48800/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:2.0:1789118008.978545:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789118008.978553:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118008.978572:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bc20f4600 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789118008.978576:0:17786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118008.978584:0:17786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789118008.978591:0:17786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789118008.978596:0:17786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789118008.978599:0:17786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789118008.978601:0:17786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789118008.978641:0:17786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118008.978660:0:17786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789118008.981935:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789118008.981968:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.981985:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f2a00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789118008.981989:0:17787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.982002:0:17787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789118008.982010:0:17787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118008.982017:0:17787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789118008.982019:0:17787:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1789118008.982038:0:17787:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1789118008.982107:0:17787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.982115:0:17787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1789118008.983509:0:21584:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff962a87d62800), last request at 1789118008 00000020:00000080:1.0:1789118008.983523:0:21584:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20d77 00000100:00080000:1.0:1789118008.983536:0:21584:0:(import.c:65:import_set_state_nolock()) ffff962a87d67000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789118008.983557:0:21584:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962a87d62800): rc 0 00000020:00000080:1.0:1789118008.983576:0:21584:0:(genops.c:885:class_export_put()) final put ffff962a87d62800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1789118008.983591:0:21584:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbc5cc1c1fae0 00000100:00080000:1.0:1789118008.983616:0:21584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789118008.983625:0:21584:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff962b98a30780 x1876025593292288/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789118018 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118008.983636:0:21584:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789118008.984495:0:21584:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789118008.984503:0:21584:0:(import.c:65:import_set_state_nolock()) ffff962bbf326800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:0.0:1789118008.984997:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a88d48800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1789118008.985093:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87d62800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789118008.985117:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a88d48000 for lustre-MDT0001 00000020:00000080:0.0:1789118008.985122:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a87d67000 for lustre-MDT0001 00000100:00080000:1.0:1789118008.986178:0:21584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789118008.986186:0:21584:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1789118008.986211:0:21584:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789118008.986277:0:21584:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789118008.986320:0:21584:0:(import.c:65:import_set_state_nolock()) ffff962b90dba800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789118008.986353:0:21584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789118008.986355:0:21584:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1789118008.986363:0:21584:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789118008.986422:0:21584:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789118008.986435:0:21584:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789118008.986480:0:21584:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff962bbcddced8) has no exports 00010000:00010000:2.0:1789118008.988100:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118008.988117:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bc20f4600/0xaa253ed19be20c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20c9e expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118008.988172:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593295744:0@lo:9:umount.0 00000100:00100000:2.0:1789118008.988253:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118008.988296:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593295872:0@lo:9:umount.0 00000100:00100000:2.0:1789118008.988323:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118008.988386:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593295744 00000100:00100000:2.0:1789118008.988408:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593295744 00000100:00100000:2.0:1789118008.988459:0:19312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593295872 00000100:00100000:2.0:1789118008.988462:0:19312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593295872 00000100:00100000:2.0:1789118008.988489:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789118008.988501:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876025593295744:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789118008.988536:0:19312:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20da1 00000100:00080000:2.0:1789118008.988547:0:19312:0:(import.c:65:import_set_state_nolock()) ffff962b82aae000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789118008.988582:0:19312:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1789118008.988750:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3643:x1876025593295744:12345-0@lo:9:umount.0 Request processed in 253us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118008.988758:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789118008.988776:0:19312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789118008.988783:0:19312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876025593295872:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789118008.988794:0:19312:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20f0d 00000100:00080000:2.0:1789118008.988800:0:19312:0:(import.c:65:import_set_state_nolock()) ffff962a88d4c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789118008.988813:0:19312:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789118008.988880:0:19312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3643:x1876025593295872:12345-0@lo:9:umount.0 Request processed in 98us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118008.988886:0:19312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1789118008.988928:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b90dba800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789118008.988935:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789118008.988936:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789118008.988939:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593295744:0@lo:9:umount.0 00000100:00080000:2.0:1789118008.988961:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bc1a36800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789118008.988968:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789118008.988970:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789118008.988972:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593295872:0@lo:9:umount.0 00010000:00010000:2.0:1789118008.988999:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789118008.989012:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118008.989021:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813da000 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789118008.989025:0:17786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118008.989035:0:17786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789118008.989042:0:17786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789118008.989049:0:17786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789118008.989079:0:17786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789118008.989082:0:17786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789118008.989112:0:17786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118008.989119:0:17786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789118008.989141:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118008.989148:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be20eea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20ef1 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118008.989173:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593296000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789118008.989201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118008.989239:0:17785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593296000 00000100:00100000:2.0:1789118008.989243:0:17785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593296000 00000100:00100000:2.0:1789118008.989265:0:17785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789118008.989275:0:17785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1876025593296000:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789118008.989282:0:17785:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789118008 with bad export cookie 12260274630570412738 00000100:00100000:0.0:1789118008.992188:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593295488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789118008.992257:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118008.992333:0:17784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789118008.992343:0:17784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789118008.994124:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.994142:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a887f2a00/0xaa253ed19be20bf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20bfd expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.994173:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789118008.994179:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.994186:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11200 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789118008.994190:0:17787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.994202:0:17787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789118008.994210:0:17787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118008.994217:0:17787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789118008.994219:0:17787:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789118008.994222:0:17787:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789118008.994274:0:17787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.994280:0:17787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789118008.994340:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.994347:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbbc11200/0xaa253ed19be2108e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be21095 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.994357:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789118008.994360:0:17787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.994366:0:17787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f3a00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789118008.994368:0:17787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.994375:0:17787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789118008.994381:0:17787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118008.994386:0:17787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789118008.994388:0:17787:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789118008.994390:0:17787:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789118008.994404:0:17787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.994410:0:17787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789118008.994417:0:17787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.994423:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a887f3a00/0xaa253ed19be20be8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa253ed19be20bef expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118008.994448:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118008.994450:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118008.994453:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118008.994467:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118008.994494:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf725e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593295616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789118008.994574:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118008.994611:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593292288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789118008.994637:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789118008.994643:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593296256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789118008.994679:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118008.994842:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593296128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789118008.994872:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118008.998668:0:17783:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789118008.998693:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593295488 00000100:00100000:3.0:1789118008.998703:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593295488 00000100:00100000:3.0:1789118008.998740:0:17783:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789118008.998745:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593295616 00000100:00100000:3.0:1789118008.998748:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593295616 00000100:00100000:3.0:1789118008.998757:0:17783:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789118008.998762:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593296256 00000100:00100000:3.0:1789118008.998764:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593296256 00000100:00100000:3.0:1789118008.998771:0:17783:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789118008.998774:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593296128 00000100:00100000:3.0:1789118008.998776:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593296128 00010000:00010000:3.0:1789118008.998792:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118008.998795:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118008.998797:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789118008.999539:0:21585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789118008.999549:0:21585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3644:x1876025593295488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789118008.999557:0:21585:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789118008 with bad export cookie 12260274630570412738 00000100:00100000:1.0:1789118008.999657:0:21585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3644:x1876025593295488:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (7389us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789118008.999677:0:21585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789118008.999695:0:21585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789118008.999700:0:21585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a81e78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876025593295616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789118008.999704:0:21585:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789118008 with bad export cookie 12260274630570412738 00000100:00100000:1.0:1789118008.999741:0:21585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a81e78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876025593295616:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (5167us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789118008.999747:0:21585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789118008.999759:0:21585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789118008.999763:0:21585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf726940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876025593296256:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789118008.999767:0:21585:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789118008 with bad export cookie 12260274630570412738 00000100:00100000:1.0:1789118008.999792:0:21585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf726940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876025593296256:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (5112us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789118008.999797:0:21585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789118008.999807:0:21585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789118008.999810:0:21585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed783c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1876025593296128:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789118008.999814:0:21585:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789118008 with bad export cookie 12260274630570412738 00000100:00100000:1.0:1789118008.999841:0:21585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed783c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1876025593296128:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (4968us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789118008.999846:0:21585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789118008.999874:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789118008.999878:0:3647:0:(import.c:65:import_set_state_nolock()) ffff962bb5c82000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789118008.999882:0:3647:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789118008.999930:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1789118009.004918:0:17785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1876025593296000:12345-0@lo:103:ldlm_bl.0 Request processed in 15635us (15709us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789118009.004932:0:17785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789118009.005036:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789118009.015452:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789118009.025910:0:3647:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.130@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789118009.025915:0:3647:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789118009.025924:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962b8eedfc00 x1876025593294336/t0(0) o400->MGC192.168.204.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789118024 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118009.029335:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962a87f69680 x1876025593296000/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789118024 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118009.029348:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962a87f6b480 x1876025593295488/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789118024 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118009.029358:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962bbf725e00 x1876025593295616/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789118024 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118009.029367:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962bbf727c00 x1876025593296256/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789118024 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118009.029375:0:3647:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962bbf724780 x1876025593296128/t0(0) o103->MGC192.168.204.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789118024 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789118009.029386:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789118009.029390:0:3647:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789118009.029391:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789118009.029490:0:3644:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff962bb5c82000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789118009.029520:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf05977c-16b5-4df3-81bb-3835e509f77c:3644:1876025593295488:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789118009.035124:0:3646:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff962bb5c82000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1789118009.035246:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593294336:0@lo:400:kworker.0 00000100:00100000:2.0:1789118009.035301:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf05977c-16b5-4df3-81bb-3835e509f77c:3646:1876025593296000:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789118009.038694:0:3645:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff962bb5c82000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1789118009.038862:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf725e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593295616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789118009.038894:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf05977c-16b5-4df3-81bb-3835e509f77c:3645:1876025593296256:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789118009.041334:0:3647:0:(import.c:65:import_set_state_nolock()) ffff962bb5c82000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789118009.041350:0:3647:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 543 00000100:00080000:1.0:1789118009.041360:0:3647:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import ffff962bb5c82000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789118009.041401:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b8ed7bc00 x1876025593296384/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789118009.041458:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf05977c-16b5-4df3-81bb-3835e509f77c:3643:1876025593296384:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1789118009.041506:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876025593296384 offset 0 length 520: 4 00000100:00100000:1.0:1789118009.041573:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf05977c-16b5-4df3-81bb-3835e509f77c:3647:1876025593296128:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1789118009.052463:0:21584:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff962bbcddced8) has no exports 00000020:01000000:0.0:1789118009.127968:0:21584:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962bbcebef00 - data ffff962b9c821510/ffff962bbd030c00 00000020:01000000:0.0:1789118009.128146:0:21584:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962a87cebea0 - data ffff962b9105a510/ffff962b8ee7e800 00000001:00000004:0.0:1789118009.141793:0:21584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1789118009.213861:0:21584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789118009.213887:0:21584:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789118009.213895:0:21584:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789118009.217916:0:21584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789118009.217924:0:21584:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789118009.218363:0:21584:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789118009.218368:0:21584:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789118009.219219:0:18542:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789118009.219232:0:18542:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1789118009.219248:0:18542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1789118009.220409:0:21584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789118009.220416:0:21584:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789118009.220442:0:21584:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789118009.220446:0:21584:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789118009.222857:0:18544:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789118009.222866:0:18544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1789118009.222883:0:18544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1789118009.224709:0:21584:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20c0b 00000020:00000080:3.0:1789118009.224722:0:21584:0:(genops.c:885:class_export_put()) final put ffff962bbd04a000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789118009.225706:0:21584:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20c20 00000020:00000080:3.0:1789118009.225718:0:21584:0:(genops.c:885:class_export_put()) final put ffff962a88429800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789118009.228571:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbd04a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1789118009.228737:0:21584:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789118009.228750:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789118009.228760:0:21584:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789118009.228765:0:21584:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff962bbcdd9a48) has no exports 00000020:00000080:1.0:1789118009.229611:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962a88429800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1789118009.230046:0:21584:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789118009.230305:0:21584:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20c74 00000020:00000080:3.0:1789118009.230317:0:21584:0:(genops.c:885:class_export_put()) final put ffff962b82aa8000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789118009.230363:0:21584:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789118009.230371:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789118009.230380:0:21584:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789118009.230384:0:21584:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff962b8ee0b490) has no exports 00000020:00000080:3.0:1789118009.230391:0:21584:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20c6d 00000020:00000080:3.0:1789118009.230395:0:21584:0:(genops.c:885:class_export_put()) final put ffff962bc1a35000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789118009.234803:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962b82aa8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:3.0:1789118009.235663:0:21584:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789118009.235669:0:21584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789118009.235673:0:21584:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789118009.235680:0:21584:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789118009.235683:0:21584:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789118009.235740:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789118009.235752:0:21584:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789118009.235761:0:21584:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20c5f 00000020:00000080:3.0:1789118009.235770:0:21584:0:(genops.c:885:class_export_put()) final put ffff962b90578800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789118009.235776:0:21584:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789118009.235782:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789118009.235786:0:21584:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789118009.235789:0:21584:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff962bbfac9a48) has no exports 00000020:00000080:3.0:1789118009.235797:0:21584:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20c58 00000020:00000080:3.0:1789118009.235801:0:21584:0:(genops.c:885:class_export_put()) final put ffff962b90dbb000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789118009.236096:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bc1a35000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789118009.236104:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bc1a36800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789118009.236112:0:14597:0:(genops.c:885:class_export_put()) final put ffff962b90dbb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789118009.236300:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962b90dbb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1789118009.236306:0:14597:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789118009.236400:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962b90578800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789118009.236405:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962b90dbb000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789118009.236637:0:21584:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789118009.236651:0:21584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789118009.236655:0:21584:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789118009.236660:0:21584:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789118009.236662:0:21584:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789118009.236730:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789118009.236737:0:21584:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789118009.236752:0:21584:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789118009.236758:0:21584:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20c43 00000020:00000080:3.0:1789118009.236764:0:21584:0:(genops.c:885:class_export_put()) final put ffff962b83cdd800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789118009.240161:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962b90dba800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789118009.240183:0:14597:0:(genops.c:885:class_export_put()) final put ffff962bc1a32800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789118009.240188:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bc1a32800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789118009.240196:0:14597:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789118009.240395:0:21584:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789118009.240404:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789118009.240414:0:21584:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789118009.240418:0:21584:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff962a87e24ed8) has no exports 00000020:00000080:3.0:1789118009.240426:0:21584:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20c3c 00000020:00000080:3.0:1789118009.240434:0:21584:0:(genops.c:885:class_export_put()) final put ffff962bbf322000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789118009.240773:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962b83cdd800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789118009.240781:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf322000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789118009.242155:0:21584:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789118009.242164:0:21584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789118009.242169:0:21584:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789118009.242177:0:21584:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789118009.242233:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789118009.242253:0:21584:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789118009.242283:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789118009.242287:0:21584:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789118009.242291:0:21584:0:(genops.c:885:class_export_put()) final put ffff962bc1a2c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789118009.242296:0:21584:0:(genops.c:844:class_export_destroy()) destroying export ffff962bc1a2c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789118009.242306:0:21584:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789118009.242458:0:21584:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20c27 00000020:00000080:0.0:1789118009.242465:0:21584:0:(genops.c:885:class_export_put()) final put ffff962a88428000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789118009.242469:0:21584:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789118009.242473:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789118009.242478:0:21584:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789118009.242481:0:21584:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff962bbd00b490) has no exports 00000020:00000080:0.0:1789118009.242502:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789118009.242505:0:21584:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789118009.242509:0:21584:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20c2e 00000020:00000080:0.0:1789118009.242513:0:21584:0:(genops.c:885:class_export_put()) final put ffff962bc1a28000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789118009.242521:0:21584:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962bbf6a1000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789118009.242524:0:21584:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962bbf6a1000 2 00000020:01000004:0.0:1789118009.242528:0:21584:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff962bbf6a1000 from lustre-MDT0001 00000020:00000080:0.0:1789118009.242543:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789118009.242547:0:21584:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789118009.242549:0:21584:0:(genops.c:885:class_export_put()) final put ffff962bbd04d000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789118009.242552:0:21584:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbd04d000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789118009.242558:0:21584:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789118009.242585:0:21584:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789118009.242588:0:21584:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789118009.242591:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789118009.242595:0:21584:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789118009.242603:0:21584:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff962a87fde800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789118009.242608:0:21584:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff962bbfac8000) has exports, disconnecting them 00000020:00080000:0.0:1789118009.242612:0:21584:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff962a87fde800), last request at 1789117910 00000020:00000080:0.0:1789118009.242622:0:21584:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20cac 00000020:00080000:0.0:1789118009.242632:0:21584:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962a87fde800): rc 0 00000020:00000080:0.0:1789118009.242636:0:21584:0:(genops.c:885:class_export_put()) final put ffff962a87fde800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789118009.243814:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbf326800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789118009.243826:0:14597:0:(genops.c:885:class_export_put()) final put ffff962b90dbf000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789118009.243829:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962b90dbf000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789118009.243835:0:14597:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789118009.243960:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962a88428000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789118009.243964:0:14597:0:(genops.c:885:class_export_put()) final put ffff962bbd04f800/lustre-MDD0001_UUID 00000020:00000080:1.0:1789118009.243966:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbd04f800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789118009.243971:0:14597:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789118009.244096:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bc1a28000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789118009.244101:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87fde800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789118009.245286:0:21584:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789118009.245295:0:21584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789118009.245300:0:21584:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789118009.245307:0:21584:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789118009.245340:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bbf4b2000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789118009.245721:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789118009.245735:0:21584:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789118009.245759:0:21584:0:(genops.c:885:class_export_put()) final put ffff962bbf4b1000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789118009.245765:0:21584:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf4b1000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789118009.245775:0:21584:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789118009.245869:0:21584:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962bbf6a1000 1 00000020:00000080:1.0:1789118009.245878:0:21584:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20bd3 00000020:00000080:1.0:1789118009.245886:0:21584:0:(genops.c:885:class_export_put()) final put ffff962bc1b5b000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789118009.245904:0:21584:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789118009.245918:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962bc1b5b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789118009.245935:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789118009.245945:0:21584:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789118009.245950:0:21584:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff962bbcddb490) has no exports 00010000:00010000:3.0:1789118009.384425:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789118009.487549:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789118009.487565:0:21584:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1789118009.487571:0:21584:0:(genops.c:885:class_export_put()) final put ffff962bbf6a5000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789118009.487576:0:21584:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf6a5000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1789118009.487585:0:21584:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1789118009.487730:0:21584:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff962bbf6a7000 00000020:01000000:3.0:1789118009.487750:0:21584:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789118009.487754:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789118009.487758:0:21584:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789118009.487762:0:21584:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff962a87e20000) has no exports 00000100:00100000:3.0:1789118009.487916:0:17800:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff962b832a3000:17800] 2 exiting: rc = 0 00000100:00100000:3.0:1789118009.488035:0:17799:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff962b832a2600:17799] 1 exiting: rc = 0 00000100:00100000:3.0:1789118009.488136:0:17798:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff962b835e2a00:17798] 0 exiting: rc = 1 00000100:00100000:2.0:1789118009.489795:0:20601:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff962a88c0de00:20601] 3 exiting: rc = 0 00000100:00100000:3.0:1789118009.489979:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.489987:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.489993:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.489998:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490004:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490009:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490015:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490020:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490025:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490031:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490036:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490042:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490047:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490077:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490084:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490090:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490095:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490100:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490106:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490111:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490116:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490121:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490126:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490132:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490137:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490144:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490165:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490171:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490176:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490183:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490188:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490193:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490198:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490203:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490209:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490215:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490221:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490227:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490233:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490238:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490243:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490248:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490253:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490259:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490264:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490270:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490276:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490281:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490286:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490291:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490297:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490302:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490308:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490313:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490318:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490324:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490330:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490335:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490341:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490346:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490352:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490365:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490372:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.490378:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.500879:0:17801:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff962a88c61800:17801] 0 exiting: rc = 1 00000100:00100000:1.0:1789118009.500999:0:17802:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff962b90306800:17802] 1 exiting: rc = 0 00000100:00100000:3.0:1789118009.501241:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501252:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501260:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501267:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501273:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501279:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501285:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501290:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501296:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501300:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501305:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501310:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501315:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501320:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501325:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501329:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501334:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501339:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501343:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501348:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501354:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501359:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501364:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501369:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501375:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501381:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501386:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501391:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501396:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501401:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501407:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501412:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501440:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501445:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501451:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501458:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501463:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501469:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501474:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501481:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501486:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501492:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501497:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501502:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501507:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501514:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501519:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501525:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501530:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501535:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501541:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501545:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501551:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501556:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501561:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501567:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501573:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501579:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501584:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501590:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501596:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501602:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501607:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.501613:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.502670:0:18751:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff962b845bf200:18751] 2 exiting: rc = 0 00000100:00100000:3.0:1789118009.508252:0:17803:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff962bb5d4c400:17803] 0 exiting: rc = 1 00000100:00100000:3.0:1789118009.509942:0:17804:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff962bb5d4d400:17804] 1 exiting: rc = 0 00000100:00100000:1.0:1789118009.510251:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510260:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510266:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510273:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510279:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510287:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510294:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510299:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510305:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510310:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510344:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510350:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510356:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510362:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510367:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510372:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510379:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510384:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510407:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510413:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510419:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510424:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510445:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510453:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510458:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510466:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510473:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510478:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510484:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510490:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510496:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510501:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510506:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510513:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510536:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510544:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510550:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510556:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510563:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510569:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510575:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510581:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510587:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510594:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510601:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510610:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510631:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510649:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510656:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510661:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510668:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510673:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510679:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510692:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510698:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510704:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510710:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510716:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510733:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510753:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510760:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510766:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510773:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.510779:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528481:0:17805:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff962b988cde00:17805] 0 exiting: rc = 1 00000100:00100000:3.0:1789118009.528691:0:17806:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff962b988cc800:17806] 1 exiting: rc = 0 00000100:00100000:1.0:1789118009.528829:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528839:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528845:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528850:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528856:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528861:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528867:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528872:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528877:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528882:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528887:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528892:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528897:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528903:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528908:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528913:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528919:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528924:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528930:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528936:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528942:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528947:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528952:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528967:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528972:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528978:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528984:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528989:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528995:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.528999:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529004:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529009:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529013:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529018:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529024:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529030:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529034:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529041:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529047:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529084:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529091:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529096:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529101:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529105:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529110:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529115:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529120:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529125:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529130:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529135:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529141:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529147:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529152:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529157:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529163:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529168:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529174:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529179:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529193:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529197:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529202:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529206:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529211:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.529216:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118009.529677:0:17807:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff962a85fb2a00:17807] 0 exiting: rc = 1 00000100:00100000:3.0:1789118009.529812:0:17808:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff962a85fb3800:17808] 1 exiting: rc = 0 00000100:00100000:1.0:1789118009.531233:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531243:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531248:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531253:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531259:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531264:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531268:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531273:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531278:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531283:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531289:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531294:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531299:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531304:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531309:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531314:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531318:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531322:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531327:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531331:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531334:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531339:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531343:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531348:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531352:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531356:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531361:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531366:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531370:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531391:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531396:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531400:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531405:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531410:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531414:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531419:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531423:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531428:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531433:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531438:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531443:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531447:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531452:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531457:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531461:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531466:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531470:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531475:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531480:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531485:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531489:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531493:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531498:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531504:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531509:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531514:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531519:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531523:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531528:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531532:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531538:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531543:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531549:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.531554:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118009.532490:0:17810:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff962a86c49200:17810] 1 exiting: rc = 0 00000100:00100000:2.0:1789118009.533727:0:17809:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff962a85fb2000:17809] 0 exiting: rc = 1 00000100:00100000:1.0:1789118009.533972:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.533980:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.533986:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.533991:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.533997:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534002:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534007:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534012:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534017:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534024:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534030:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534035:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534041:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534046:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534077:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534085:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534090:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534095:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534099:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534104:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534108:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534113:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534117:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534123:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534128:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534132:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534137:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534142:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534146:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534151:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534156:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534161:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534166:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534170:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534175:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534195:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534200:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534205:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534210:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534215:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534220:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534225:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534230:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534235:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534241:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534246:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534252:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534257:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534262:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534267:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534272:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534277:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534281:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534286:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534291:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534296:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534302:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534307:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534312:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534317:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534321:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534326:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534330:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.534336:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789118009.537386:0:17811:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff962a85fb3a00:17811] 0 exiting: rc = 1 00000100:00100000:0.0:1789118009.537760:0:17813:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff962b98adc600:17813] 2 exiting: rc = 0 00000100:00100000:3.0:1789118009.538377:0:17812:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff962bb0bdd000:17812] 1 exiting: rc = 0 00000100:00100000:1.0:1789118009.538600:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538607:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538612:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538617:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538623:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538646:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538681:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538687:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538693:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538700:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538706:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538713:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538719:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538726:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538733:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538739:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538745:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538750:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538757:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538762:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538768:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538774:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538780:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538784:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538790:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538795:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538801:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538806:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538811:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538817:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538836:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538843:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538849:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538854:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538860:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538865:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538871:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538876:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538882:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538888:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538893:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538909:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538915:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538920:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538926:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538931:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538936:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538942:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538948:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538953:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538959:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538964:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538970:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538975:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.538996:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.539003:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.539008:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.539013:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.539019:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.539024:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.539030:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.539035:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.539041:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118009.539081:0:21584:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789118009.549482:0:21584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789118009.549498:0:21584:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789118009.549505:0:21584:0:(genops.c:885:class_export_put()) final put ffff962a887a4000/MDS_uuid 00000020:00000080:0.0:1789118009.549510:0:21584:0:(genops.c:844:class_export_destroy()) destroying export ffff962a887a4000/MDS_uuid for MDS 00000020:01000000:0.0:1789118009.549516:0:21584:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789118009.549690:0:21584:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1789118010.407344:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118011.429294:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118012.454368:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789118013.285421:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) bf05977c-16b5-4df3-81bb-3835e509f77c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789118013.285430:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) bf05977c-16b5-4df3-81bb-3835e509f77c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789118013.285434:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789118013.285437:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789118013.285441:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962b84784000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789118013.285450:0:14597:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 660 00000100:00080000:1.0:1789118013.285455:0:14597:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789118013.285477:0:14597:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff962b84784000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789118013.285514:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b8ed792c0 x1876025593296512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789118013.285585:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789118013.285589:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789118013.285591:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962a81e47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789118013.285595:0:14597:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 660 00000100:00080000:1.0:1789118013.285597:0:14597:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789118013.285601:0:14597:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff962a81e47000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789118013.285612:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b8ed7a1c0 x1876025593296768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789118013.285660:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789118013.285678:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593296896:0@lo:400:kworker.0 00000400:00000100:1.0:1789118013.285727:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593296896 offset 0 length 224: 4 00000100:00100000:3.0:1789118013.285910:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789118013.285920:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593296640:0@lo:400:kworker.0 00000400:00000100:3.0:1789118013.285943:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593296640 offset 0 length 224: 4 00000100:00100000:0.0:1789118013.286164:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593296512:0@lo:38:kworker.0 00000400:00000100:0.0:1789118013.286187:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593296512 offset 0 length 520: 4 00000100:00100000:0.0:1789118013.286204:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593296768:0@lo:38:kworker.0 00000400:00000100:0.0:1789118013.286217:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593296768 offset 0 length 520: 4 00010000:00010000:0.0:1789118013.477311:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789118013.865822:0:21786:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789118013.878275:0:21786:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789118013.878359:0:21786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d4d expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118013.878377:0:21786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20d4d expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118013.878385:0:21786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20d4d expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118013.878393:0:21786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20d4d expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118013.878419:0:21786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789118013.878426:0:21786:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789118013.878454:0:21786:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789118013.878470:0:21786:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962b8ed792c0 x1876025593296512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789118033 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118013.878491:0:21786:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789118013.878497:0:21786:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789118013.878503:0:21786:0:(import.c:65:import_set_state_nolock()) ffff962b84784000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789118013.878508:0:21786:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789118013.878527:0:21786:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962b8ed792c0 x1876025593296512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789118033 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118013.878534:0:21786:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789118013.878537:0:21786:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00010000:00010000:1.0:1789118013.878608:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789118013.878618:0:17786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20d4d expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118013.878627:0:17786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db400 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789118013.878632:0:17786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20d4d expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118013.878642:0:17786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be20d4d expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789118013.878651:0:17786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be20d4d expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118013.878668:0:17786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789118013.878671:0:17786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789118013.878673:0:17786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789118013.878693:0:17786:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bb5c82000 00010000:00010000:1.0:1789118013.878697:0:17786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be20d4d expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118013.878704:0:17786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813db400/0xaa253ed19be20d46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be20d4d expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118013.878715:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118013.878717:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118013.878719:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118013.879022:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593296512:0@lo:38:kworker.0 00000100:00080000:3.0:1789118013.880484:0:21786:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789118013.880504:0:21786:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962b8ed79a40 x1876025593296640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118029 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118013.880607:0:21786:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789118013.880616:0:21786:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789118013.880662:0:21786:0:(import.c:65:import_set_state_nolock()) ffff962a86a7b000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789118013.880763:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876025593297024:0@lo:39:umount.0 00000400:00000100:2.0:1789118013.880842:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593297024 offset 0 length 224: 4 00000100:00100000:1.0:1789118013.881446:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593296640:0@lo:400:kworker.0 00000100:00080000:0.0:1789118014.312425:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) bf05977c-16b5-4df3-81bb-3835e509f77c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789118014.312437:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) bf05977c-16b5-4df3-81bb-3835e509f77c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789118014.312441:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789118014.312444:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789118014.312687:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593297152:0@lo:400:kworker.0 00000400:00000100:1.0:1789118014.312770:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593297152 offset 0 length 224: 4 00010000:00010000:1.0:1789118014.501372:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789118014.823381:0:20127:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789118014.823392:0:20127:0:(genops.c:885:class_export_put()) final put ffff962a88d4f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789118014.823482:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a88d4f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789118014.823532:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a88d4c800 for lustre-OST0001 00000001:00100000:0.0:1789118014.823961:0:19307:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789118014.823965:0:19307:0:(genops.c:885:class_export_put()) final put ffff962b82aac800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789118014.824290:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962b82aac800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789118014.830549:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962b82aae000 for lustre-OST0000 00010000:00010000:0.0:1789118015.525622:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118016.549300:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118017.573299:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789118018.341318:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) bf05977c-16b5-4df3-81bb-3835e509f77c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789118018.341330:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) bf05977c-16b5-4df3-81bb-3835e509f77c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789118018.341334:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789118018.341337:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789118018.341516:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789118018.341546:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593297280:0@lo:400:kworker.0 00000400:00000100:2.0:1789118018.341621:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593297280 offset 0 length 224: 4 00010000:00010000:0.0:1789118018.597246:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118019.621932:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118020.005232:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789118009/real 1789118009] req@ffff962b8ed7bc00 x1876025593296384/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789118019 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118020.005282:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962b8ed7bc00 x1876025593296384/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789118019 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789118020.005319:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bb5c82000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789118020.005350:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789118020.005354:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf05977c-16b5-4df3-81bb-3835e509f77c:3643:1876025593296384:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:1.0:1789118020.005570:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) bf05977c-16b5-4df3-81bb-3835e509f77c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789118020.005577:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789118020.005581:0:36:0:(import.c:65:import_set_state_nolock()) ffff962bb5c82000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789118020.005588:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 661 00000100:00080000:1.0:1789118020.005596:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789118020.005633:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import ffff962bb5c82000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789118020.005677:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b8ed79a40 x1876025593297408/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789118020.005707:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789118020.005712:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789118020.005889:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593297536:0@lo:400:kworker.0 00000100:00100000:2.0:1789118020.005895:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf05977c-16b5-4df3-81bb-3835e509f77c:3643:1876025593297408:0@lo:250:kworker.0 00000400:00000100:2.0:1789118020.005983:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876025593297408 offset 0 length 520: 4 00000400:00000100:3.0:1789118020.009750:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593297536 offset 0 length 224: 4 00010000:00010000:1.0:1789118020.646011:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118021.669231:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118022.693333:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118023.080116:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789118013/real 1789118013] req@ffff962bbf724f00 x1876025593297024/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789118023 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118023.080167:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962bbf724f00 x1876025593297024/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789118023 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789118023.080190:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a86a7b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789118023.080211:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876025593297024:0@lo:39:umount.0 00000100:00080000:3.0:1789118023.080326:0:21786:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789118023.080332:0:21786:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789118023.080339:0:21786:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789118023.081414:0:21786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20d23 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118023.081450:0:21786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20d23 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118023.081457:0:21786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20d23 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118023.081463:0:21786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20d23 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118023.081492:0:21786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789118023.081500:0:21786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21087 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118023.081507:0:21786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21087 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118023.081514:0:21786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be21087 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118023.081520:0:21786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be21087 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118023.081531:0:21786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789118023.081535:0:21786:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789118023.081563:0:21786:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789118023.081568:0:21786:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789118023.081573:0:21786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789118023.081578:0:21786:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789118023.081582:0:21786:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff962b8ee08000) has no exports 00000020:00080000:3.0:1789118023.081696:0:21786:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff962b8ee08000) has no exports 00010000:00010000:0.0:1789118023.081992:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789118023.082005:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20d23 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118023.082012:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9ae00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789118023.082015:0:18557:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20d23 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118023.082023:0:18557:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be20d23 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789118023.082030:0:18557:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be20d23 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789118023.082034:0:18557:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789118023.082037:0:18557:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789118023.082039:0:18557:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789118023.082075:0:18557:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bb5c82000 00010000:00010000:0.0:1789118023.082079:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be20d23 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118023.082085:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9ae00/0xaa253ed19be20d1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be20d23 expref: -99 pid: 19306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118023.082099:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118023.082102:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be21087 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118023.082108:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d200 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:0.0:1789118023.082111:0:18557:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be21087 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118023.082126:0:18557:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be21087 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789118023.082132:0:18557:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be21087 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789118023.082138:0:18557:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789118023.082140:0:18557:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789118023.082141:0:18557:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789118023.082146:0:18557:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bb5c82000 00010000:00010000:0.0:1789118023.082148:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be21087 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118023.082154:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be21080 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be21087 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118023.082162:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118023.082164:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118023.082166:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118023.083776:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789118023.090342:0:21786:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962b832a9420 - data ffff962b9c9f7d80/ffff962bbd031400 00000020:01000000:3.0:1789118023.090557:0:21786:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962a886048a0 - data ffff962a8600eca8/ffff962bb0cc6c00 00100000:10000000:3.0:1789118023.098288:0:21786:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789118023.105286:0:21786:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20d31 00000020:00000080:2.0:1789118023.105299:0:21786:0:(genops.c:885:class_export_put()) final put ffff962a87e2b000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789118023.105313:0:21786:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962bc1b5c000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789118023.105317:0:21786:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962bc1b5c000 2 00000020:01000004:2.0:1789118023.105319:0:21786:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff962bc1b5c000 from lustre-OST0000 00000020:00000080:2.0:1789118023.105343:0:21786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789118023.105352:0:21786:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789118023.105355:0:21786:0:(genops.c:885:class_export_put()) final put ffff962a87e2b800/lustre-OST0000_UUID 00000020:00000080:2.0:1789118023.105358:0:21786:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87e2b800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789118023.105363:0:21786:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789118023.105431:0:21786:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789118023.105436:0:21786:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789118023.105440:0:21786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789118023.105445:0:21786:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789118023.105452:0:21786:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff962b84785000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789118023.105457:0:21786:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff962a87e21a48) has exports, disconnecting them 00000020:00080000:2.0:1789118023.105462:0:21786:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff962b84785000), last request at 1789117931 00000020:00000080:2.0:1789118023.105466:0:21786:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20d5b 00000020:00080000:2.0:1789118023.105475:0:21786:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962b84785000): rc 0 00000020:00000080:2.0:1789118023.105479:0:21786:0:(genops.c:885:class_export_put()) final put ffff962b84785000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789118023.106234:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87e2b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789118023.106254:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962b84785000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789118023.165183:0:21786:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789118023.165194:0:21786:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789118023.165200:0:21786:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789118023.165211:0:21786:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789118023.165468:0:21786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789118023.165478:0:21786:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1789118023.165486:0:21786:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789118023.165494:0:21786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789118023.165498:0:21786:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789118023.165506:0:21786:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff962a86a7c000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789118023.165522:0:21786:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff962bbd2b3490) has exports, disconnecting them 00000020:00080000:0.0:1789118023.165526:0:21786:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff962a86a7c000), last request at 1789117931 00000020:00000080:0.0:1789118023.165531:0:21786:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20d70 00000020:00000080:1.0:1789118023.165536:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962b84784000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789118023.165544:0:36:0:(genops.c:885:class_export_put()) final put ffff962b84782000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789118023.165548:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962b84782000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:00080000:0.0:1789118023.165548:0:21786:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962a86a7c000): rc 0 00000020:00000080:0.0:1789118023.165553:0:21786:0:(genops.c:885:class_export_put()) final put ffff962a86a7c000/lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789118023.165565:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789118023.165632:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a86a7c000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1789118023.169302:0:21786:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789118023.169311:0:21786:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789118023.169315:0:21786:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789118023.169323:0:21786:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789118023.169541:0:21786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789118023.169551:0:21786:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1789118023.169558:0:21786:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962bc1b5c000 1 00000020:00000080:0.0:1789118023.169564:0:21786:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20d0e 00000020:00000080:0.0:1789118023.169573:0:21786:0:(genops.c:885:class_export_put()) final put ffff962b95fc1000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789118023.169579:0:21786:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789118023.169586:0:21786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789118023.169591:0:21786:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789118023.169595:0:21786:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff962a87e23490) has no exports 00000020:00000080:0.0:1789118023.176395:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a86a7b000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789118023.176483:0:36:0:(genops.c:885:class_export_put()) final put ffff962a86a79800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789118023.176487:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962a86a79800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789118023.176502:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789118023.176580:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff962b95fc1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789118023.227220:0:21786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789118023.227236:0:21786:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789118023.227242:0:21786:0:(genops.c:885:class_export_put()) final put ffff962bbf4b1800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789118023.227247:0:21786:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf4b1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789118023.227260:0:21786:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789118023.227396:0:21786:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff962bbf4b0000 00000020:02000400:0.0:1789118023.227482:0:21786:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789118023.719198:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118024.743912:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789118025.063333:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) bf05977c-16b5-4df3-81bb-3835e509f77c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789118025.063352:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) bf05977c-16b5-4df3-81bb-3835e509f77c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789118025.063356:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789118025.063359:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789118025.064606:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593297664:0@lo:400:kworker.0 00000400:00000100:1.0:1789118025.064686:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593297664 offset 0 length 224: 4 00010000:00010000:1.0:1789118025.769924:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118026.789170:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789118027.215629:0:21988:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789118027.227665:0:21988:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789118027.227769:0:21988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20eb2 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118027.227782:0:21988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20eb2 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118027.227789:0:21988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20eb2 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118027.227796:0:21988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20eb2 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118027.227813:0:21988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789118027.227818:0:21988:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789118027.227855:0:21988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789118027.227866:0:21988:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962b8ed7a1c0 x1876025593296768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789118033 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118027.227888:0:21988:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789118027.227895:0:21988:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789118027.227901:0:21988:0:(import.c:65:import_set_state_nolock()) ffff962a81e47000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789118027.227906:0:21988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789118027.227909:0:21988:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962b8ed7a1c0 x1876025593296768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789118033 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118027.227916:0:21988:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789118027.227934:0:21988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00010000:00010000:1.0:1789118027.229096:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789118027.229109:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20eb2 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118027.229121:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9a800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789118027.229125:0:18557:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20eb2 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118027.229154:0:18557:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be20eb2 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789118027.229163:0:18557:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be20eb2 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118027.229169:0:18557:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789118027.229172:0:18557:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789118027.229175:0:18557:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789118027.229193:0:18557:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bb5c82000 00010000:00010000:1.0:1789118027.229197:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be20eb2 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118027.229204:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962baea9a800/0xaa253ed19be20eab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be20eb2 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118027.229215:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118027.229217:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118027.229218:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118027.229321:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593296768:0@lo:38:kworker.0 00000100:00080000:3.0:1789118027.231009:0:21988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789118027.231027:0:21988:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962b8ed78000 x1876025593296896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118029 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118027.231050:0:21988:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962a87d9e940 x1876025593297152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118030 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118027.231087:0:21988:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962bbf727840 x1876025593297280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118034 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118027.231101:0:21988:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962b8ed79e00 x1876025593297536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118036 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118027.231110:0:21988:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962a87f68b40 x1876025593297664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118041 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118027.231123:0:21988:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1789118027.231160:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593297152:0@lo:400:kworker.0 00000100:00100000:3.0:1789118027.231168:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876025593296896:0@lo:400:kworker.0 00000100:00100000:3.0:1789118027.231208:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593297536:0@lo:400:kworker.0 00000100:00100000:3.0:1789118027.231217:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593297280:0@lo:400:kworker.0 00000100:00080000:3.0:1789118027.231234:0:21988:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789118027.231256:0:21988:0:(import.c:65:import_set_state_nolock()) ffff962a81e45800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789118027.232385:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876025593297792:0@lo:39:umount.0 00000400:00000100:0.0:1789118027.232444:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876025593297792 offset 0 length 224: 4 00000100:00100000:1.0:1789118027.237310:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593297664:0@lo:400:kworker.0 00010000:00010000:1.0:1789118027.813417:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118028.837203:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118029.862103:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789118030.184493:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) bf05977c-16b5-4df3-81bb-3835e509f77c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789118030.184505:0:14597:0:(pinger.c:247:ptlrpc_pinger_process_import()) bf05977c-16b5-4df3-81bb-3835e509f77c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789118030.893571:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118031.909315:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118032.934505:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118033.957583:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118034.981441:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789118035.302612:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) bf05977c-16b5-4df3-81bb-3835e509f77c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789118035.302623:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) bf05977c-16b5-4df3-81bb-3835e509f77c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789118035.429690:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789118020/real 1789118020] req@ffff962b8ed79a40 x1876025593297408/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789118035 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118035.429757:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962b8ed79a40 x1876025593297408/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789118035 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789118035.429780:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bb5c82000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789118035.429810:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789118035.429815:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf05977c-16b5-4df3-81bb-3835e509f77c:3643:1876025593297408:0@lo:250:kworker.0 00000100:00080000:3.0:1789118035.429950:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) bf05977c-16b5-4df3-81bb-3835e509f77c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789118035.429957:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789118035.429960:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962bb5c82000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789118035.429967:0:14597:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 672 00000100:00080000:3.0:1789118035.429972:0:14597:0:(import.c:589:import_select_connection()) MGC192.168.204.130@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789118035.429982:0:14597:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import ffff962bb5c82000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118035.430043:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf724000 x1876025593297920/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789118035.430497:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf05977c-16b5-4df3-81bb-3835e509f77c:3643:1876025593297920:0@lo:250:kworker.0 00000400:00000100:0.0:1789118035.430566:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876025593297920 offset 0 length 520: 4 00010000:00010000:1.0:1789118036.005419:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118037.029430:0:17787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118037.479587:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789118027/real 1789118027] req@ffff962bbf727840 x1876025593297792/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789118037 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118037.479619:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962bbf727840 x1876025593297792/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789118037 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789118037.479664:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a81e45800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789118037.479688:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876025593297792:0@lo:39:umount.0 00000100:00080000:2.0:1789118037.479784:0:21988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789118037.479789:0:21988:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789118037.479793:0:21988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789118037.480763:0:21988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be20e88 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118037.480778:0:21988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be20e88 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118037.480784:0:21988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20e88 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118037.480804:0:21988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be20e88 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118037.480835:0:21988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789118037.480843:0:21988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21079 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118037.480849:0:21988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21079 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118037.480855:0:21988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be21079 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118037.480861:0:21988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa253ed19be21079 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118037.480880:0:21988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789118037.480885:0:21988:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789118037.480911:0:21988:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789118037.480915:0:21988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789118037.480920:0:21988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789118037.480925:0:21988:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789118037.480930:0:21988:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff962a88d18000) has no exports 00000020:00080000:2.0:1789118037.481045:0:21988:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff962a88d18000) has no exports 00010000:00010000:1.0:1789118037.482232:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789118037.482246:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20e88 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118037.482257:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789118037.482262:0:18557:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be20e88 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118037.482272:0:18557:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be20e88 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789118037.482279:0:18557:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be20e88 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118037.482285:0:18557:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789118037.482288:0:18557:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1789118037.482291:0:18557:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1789118037.482311:0:18557:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bb5c82000 00010000:00010000:1.0:1789118037.482314:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be20e88 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118037.482321:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be20e81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be20e88 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118037.482335:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789118037.482339:0:18557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be21079 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118037.482344:0:18557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10400 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789118037.482347:0:18557:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa253ed19be21079 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118037.482369:0:18557:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be21079 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789118037.482375:0:18557:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be21079 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118037.482380:0:18557:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789118037.482382:0:18557:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789118037.482384:0:18557:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789118037.482388:0:18557:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bb5c82000 00010000:00010000:1.0:1789118037.482391:0:18557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be21079 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118037.482397:0:18557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbbc10400/0xaa253ed19be21072 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be21079 expref: -99 pid: 17796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118037.482410:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118037.482412:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118037.482413:0:18557:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118037.482532:0:17786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789118037.487455:0:21988:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962b8e9e80c0 - data ffff962b9c9fd5e8/ffff962bb02f8400 00000020:01000000:2.0:1789118037.487653:0:21988:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff962a8879f840 - data ffff962a860bc360/ffff962a87c80800 00100000:10000000:2.0:1789118037.497882:0:21988:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789118037.514436:0:21988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20e96 00000020:00000080:1.0:1789118037.514451:0:21988:0:(genops.c:885:class_export_put()) final put ffff962a88d49000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1789118037.514475:0:21988:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962a87e28800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1789118037.514479:0:21988:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962a87e28800 2 00000020:01000004:1.0:1789118037.514482:0:21988:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff962a87e28800 from lustre-OST0001 00000020:00000080:1.0:1789118037.514512:0:21988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789118037.514528:0:21988:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1789118037.514531:0:21988:0:(genops.c:885:class_export_put()) final put ffff962a88d4e000/lustre-OST0001_UUID 00000020:00000080:1.0:1789118037.514535:0:21988:0:(genops.c:844:class_export_destroy()) destroying export ffff962a88d4e000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1789118037.514543:0:21988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1789118037.514683:0:21988:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import bf05977c-16b5-4df3-81bb-3835e509f77c->MGS 00010000:00010000:1.0:1789118037.514711:0:21988:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a887f3800/0xaa253ed19be20bda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be20be1 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789118037.514725:0:21988:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a887f3800/0xaa253ed19be20bda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be20be1 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118037.514732:0:21988:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789118037.514735:0:21988:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789118037.514738:0:21988:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789118037.514754:0:21988:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bb5c82000 00010000:00010000:1.0:1789118037.514758:0:21988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a887f3800/0xaa253ed19be20bda lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be20be1 expref: -99 pid: 18533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118037.514772:0:21988:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789118037.514779:0:21988:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118037.514784:0:21988:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789118037.514786:0:21988:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789118037.514788:0:21988:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789118037.514797:0:21988:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff962bb5c82000 00010000:00010000:1.0:1789118037.514800:0:21988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b813db200/0xaa253ed19be20ac9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa253ed19be20ad0 expref: -99 pid: 17777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789118037.514818:0:21988:0:(import.c:65:import_set_state_nolock()) ffff962bb5c82000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789118037.514822:0:21988:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789118037.514826:0:21988:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789118037.514827:0:21988:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789118037.514832:0:21988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789118037.514844:0:21988:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff962bbf724000 x1876025593297920/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789118055 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789118037.515166:0:21988:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789118037.515170:0:21988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:0.0:1789118037.515238:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf05977c-16b5-4df3-81bb-3835e509f77c:3643:1876025593297920:0@lo:250:kworker.0 10000000:01000000:1.0:1789118037.515499:0:21988:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789118037.515508:0:21988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20ab4 00000020:00000080:1.0:1789118037.515515:0:21988:0:(genops.c:885:class_export_put()) final put ffff962a887a0800/bf05977c-16b5-4df3-81bb-3835e509f77c 00000020:01000000:1.0:1789118037.515524:0:21988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.130@tcp (flags='') 00000020:00000080:1.0:1789118037.515530:0:21988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789118037.515536:0:21988:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.130@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789118037.515540:0:21988:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff962bbfacced8) has no exports 10000000:01000000:0.0:1789118037.515617:0:17796:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1789118037.516645:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962a88d49000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789118037.516681:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962a887a0800/bf05977c-16b5-4df3-81bb-3835e509f77c for MGC192.168.204.130@tcp 10000000:01000000:1.0:1789118037.517305:0:21988:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.130@tcp: client import never connected 00000100:00080000:1.0:1789118037.517313:0:21988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789118037.517317:0:21988:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789118037.517321:0:21988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789118037.517325:0:21988:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789118037.517405:0:21988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789118037.517416:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962bb5c82000 for MGC192.168.204.130@tcp 00000020:00000080:1.0:1789118037.517416:0:21988:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.130@tcp (uuid bf05977c-16b5-4df3-81bb-3835e509f77c) 00000020:01000000:1.0:1789118037.517425:0:21988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789118037.517427:0:14597:0:(genops.c:885:class_export_put()) final put ffff962b9832f800/bf05977c-16b5-4df3-81bb-3835e509f77c 00000020:00000080:2.0:1789118037.517431:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962b9832f800/bf05977c-16b5-4df3-81bb-3835e509f77c for MGC192.168.204.130@tcp 00000020:00000080:1.0:1789118037.517433:0:21988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:01000000:2.0:1789118037.517437:0:14597:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.130@tcp (bf05977c-16b5-4df3-81bb-3835e509f77c) 00000020:00000080:1.0:1789118037.517438:0:21988:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789118037.517447:0:21988:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff962a81e43000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789118037.517453:0:21988:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff962b88028000) has exports, disconnecting them 00000020:00080000:1.0:1789118037.517458:0:21988:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff962a81e43000), last request at 1789117951 00000020:00000080:1.0:1789118037.517464:0:21988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20ec0 00000020:00080000:1.0:1789118037.517482:0:21988:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962a81e43000): rc 0 00000020:00000080:1.0:1789118037.517487:0:21988:0:(genops.c:885:class_export_put()) final put ffff962a81e43000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789118037.517735:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962a81e43000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1789118037.525183:0:21988:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789118037.525193:0:21988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789118037.525197:0:21988:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789118037.525204:0:21988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789118037.525406:0:21988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789118037.525418:0:21988:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789118037.525419:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a81e47000 for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789118037.525426:0:21988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789118037.525432:0:14597:0:(genops.c:885:class_export_put()) final put ffff962a81e46000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789118037.525432:0:21988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789118037.525436:0:21988:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00000080:2.0:1789118037.525437:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962a81e46000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789118037.525444:0:14597:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00080000:1.0:1789118037.525446:0:21988:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff962a81e45000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789118037.525452:0:21988:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff962b8802b490) has exports, disconnecting them 00000020:00080000:1.0:1789118037.525457:0:21988:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff962a81e45000), last request at 1789117951 00000020:00000080:1.0:1789118037.525461:0:21988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20ed5 00000020:00080000:1.0:1789118037.525475:0:21988:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff962a81e45000): rc 0 00000020:00000080:1.0:1789118037.525479:0:21988:0:(genops.c:885:class_export_put()) final put ffff962a81e45000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1789118037.525514:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962a81e45000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1789118037.539162:0:21988:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789118037.539174:0:21988:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789118037.539180:0:21988:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789118037.539191:0:21988:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789118037.539238:0:14597:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff962a81e45800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789118037.660817:0:17787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789118037.664933:0:18557:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789118037.669124:0:17786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789118037.669559:0:17781:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff962a8681d800:17781] 0 exiting: rc = 1 00000100:00100000:0.0:1789118037.669683:0:17782:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff962a87c16000:17782] 1 exiting: rc = 0 00000100:00100000:2.0:1789118037.669789:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.670330:0:17785:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff962a8681dc00:17785] 2 exiting: rc = 0 00000100:00100000:0.0:1789118037.670525:0:17784:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff962a87c17c00:17784] 1 exiting: rc = 0 00000100:00100000:0.0:1789118037.670964:0:21585:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff962b86206600:21585] 3 exiting: rc = 0 00000100:00100000:3.0:1789118037.673640:0:17783:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff962a87c17200:17783] 0 exiting: rc = 1 00000100:00100000:2.0:1789118037.674598:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674608:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674615:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674620:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674627:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674634:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674641:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674645:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674651:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674657:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674677:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674681:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674686:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674691:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674697:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674702:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674707:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674712:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674716:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674721:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674726:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674732:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674751:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674758:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674764:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674770:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674775:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674780:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674786:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674790:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674797:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674801:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674806:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674824:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674830:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674835:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674841:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674847:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674852:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674856:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674862:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674867:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674871:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674876:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674883:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674908:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674915:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674923:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674931:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674937:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674942:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674947:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674956:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674965:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674970:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674975:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674981:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674993:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.674999:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.675005:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.675010:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.675016:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.675022:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.675027:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789118037.676181:0:21988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789118037.676193:0:21988:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1789118037.676201:0:21988:0:(genops.c:885:class_export_put()) final put ffff962a81e41800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1789118037.676208:0:21988:0:(genops.c:844:class_export_destroy()) destroying export ffff962a81e41800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1789118037.676216:0:21988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1789118037.676459:0:21988:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962a87e28800 1 00000020:00000080:2.0:1789118037.676465:0:21988:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xaa253ed19be20e7a 00000020:00000080:2.0:1789118037.676471:0:21988:0:(genops.c:885:class_export_put()) final put ffff962a86cca000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789118037.676487:0:21988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789118037.676491:0:21988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789118037.676495:0:21988:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789118037.676499:0:21988:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff962b8ee0ced8) has no exports 00000020:00000080:0.0:1789118037.676546:0:14597:0:(genops.c:844:class_export_destroy()) destroying export ffff962a86cca000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789118037.768839:0:21988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789118037.768865:0:21988:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789118037.768875:0:21988:0:(genops.c:885:class_export_put()) final put ffff962a87e2e000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789118037.768881:0:21988:0:(genops.c:844:class_export_destroy()) destroying export ffff962a87e2e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789118037.768897:0:21988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789118037.770159:0:21988:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff962a87e29800 00000020:01000000:1.0:1789118037.770192:0:21988:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789118037.770199:0:21988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789118037.770204:0:21988:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789118037.770210:0:21988:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff962b8ee09a48) has no exports 00000020:00000080:1.0:1789118037.770318:0:21988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789118037.770326:0:21988:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789118037.770330:0:21988:0:(genops.c:885:class_export_put()) final put ffff962bbf324000/OSS_uuid 00000020:00000080:1.0:1789118037.770333:0:21988:0:(genops.c:844:class_export_destroy()) destroying export ffff962bbf324000/OSS_uuid for OSS 00000020:01000000:1.0:1789118037.770338:0:21988:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789118037.770530:0:19311:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff962bb5d4ae00:19311] 0 exiting: rc = 1 00000100:00080000:3.0:1789118037.770667:0:17794:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789118037.770852:0:20393:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff962a87d6b200:20393] 3 exiting: rc = 0 00000100:00100000:3.0:1789118037.770907:0:19313:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff962bbf7c7600:19313] 2 exiting: rc = 0 00000100:00100000:3.0:1789118037.770968:0:19312:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff962b91636600:19312] 1 exiting: rc = 0 00000100:00100000:3.0:1789118037.771043:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771051:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771078:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771085:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771092:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771098:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771118:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771124:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771130:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771135:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771141:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771146:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771152:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771157:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771164:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771170:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771175:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771181:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771187:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771192:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771197:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771202:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771208:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771222:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771229:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771234:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771255:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771259:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771264:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771269:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771274:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771280:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771285:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771290:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771296:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771301:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771306:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771312:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771317:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771322:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771327:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771332:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771337:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771353:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771359:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771364:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771369:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771375:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771380:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771385:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771391:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771397:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771403:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771408:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771414:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771419:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771424:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771429:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771434:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771439:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771444:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771456:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771462:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.771468:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.772969:0:19314:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff962b90e2dc00:19314] 0 exiting: rc = 1 00000100:00100000:1.0:1789118037.773264:0:19315:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff962b8ee7a600:19315] 1 exiting: rc = 0 00000100:00100000:3.0:1789118037.773469:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773478:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773484:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773490:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773495:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773501:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773506:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773512:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773518:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773523:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773529:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773534:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773540:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773545:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773551:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773556:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773638:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773645:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773651:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773656:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773661:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773667:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773674:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773680:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773685:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773692:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773697:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773703:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773708:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773713:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773719:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773738:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773744:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773750:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773757:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773763:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773769:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773776:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773781:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773787:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773792:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773799:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773805:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773810:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773816:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773821:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773827:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773833:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773839:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773846:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773858:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773869:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773877:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773883:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773889:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773894:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773900:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773905:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773910:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773915:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773920:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773926:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773932:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.773937:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118037.778444:0:19316:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff962b8ee7b200:19316] 0 exiting: rc = 1 00000100:00100000:3.0:1789118037.780722:0:19317:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff962b8ee7a800:19317] 1 exiting: rc = 0 00000100:00100000:0.0:1789118037.781289:0:19318:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff962b8ee7b400:19318] 2 exiting: rc = 0 00000100:00100000:3.0:1789118037.782366:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782390:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782398:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782404:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782411:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782418:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782426:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782431:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782448:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782456:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782461:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782468:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782473:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782478:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782485:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782491:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782498:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782503:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782509:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782515:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782520:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782525:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782531:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782537:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782543:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782549:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782554:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782572:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782579:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782585:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782591:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782596:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782617:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782625:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782631:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782638:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782652:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782658:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782664:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782670:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782676:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782682:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782688:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782694:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782699:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782706:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782712:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782719:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782725:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782730:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782735:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782743:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782754:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782760:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782767:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782772:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782789:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782796:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782802:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782808:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782815:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782820:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782825:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.782838:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789118037.795584:0:19319:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff962bbcfad200:19319] 0 exiting: rc = 1 00000100:00100000:1.0:1789118037.795701:0:19320:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff962bb5c61a00:19320] 1 exiting: rc = 0 00000100:00100000:2.0:1789118037.795956:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.795964:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.795970:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.795983:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.795988:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.795994:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796000:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796006:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796011:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796016:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796023:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796029:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796034:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796040:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796046:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796083:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796091:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796097:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796116:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796122:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796128:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796133:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796138:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796143:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796148:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796154:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796159:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796164:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796169:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796174:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796179:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796184:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796188:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796194:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796200:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796206:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796212:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796236:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796248:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796253:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796259:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796265:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796270:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796275:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796281:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796286:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796292:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796298:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796303:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796309:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796314:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796318:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796323:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796329:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796334:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796339:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796345:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796351:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796356:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796361:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796366:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796372:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796377:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.796383:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789118037.797468:0:19322:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff962b8ec4c200:19322] 1 exiting: rc = 0 00000100:00100000:1.0:1789118037.797722:0:19321:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff962ba1a3fc00:19321] 0 exiting: rc = 1 00000100:00100000:2.0:1789118037.797835:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797869:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797877:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797887:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797894:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797899:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797906:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797912:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797919:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797937:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797944:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797950:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797957:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797977:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797984:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797990:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.797995:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798001:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798007:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798013:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798019:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798026:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798032:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798038:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798045:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798117:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798126:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798133:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798140:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798149:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798156:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798164:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798173:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798181:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798190:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798197:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798205:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798231:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798243:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798250:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798256:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798263:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798271:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798277:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798290:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798296:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798303:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798310:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798316:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798340:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798347:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798353:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798360:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798368:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798375:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798382:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798388:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798395:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798402:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798409:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798416:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798423:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798429:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789118037.798444:0:21988:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789118037.829721:0:21988:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789118062.517871:0:22756:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789118076.869325:0:23356:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789118076.869334:0:23356:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789118076.869336:0:23356:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789118076.869509:0:23356:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff962a8795a800 00000020:01000004:0.0:1789118076.869530:0:23356:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789118076.869540:0:23356:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789118076.869560:0:23356:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff962bbd2b3490) 00000020:00000080:0.0:1789118076.869579:0:23356:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789118076.952323:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789118076.953466:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.954800:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789118076.955089:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789118076.955521:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789118076.955750:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789118076.955974:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789118076.956191:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789118076.956423:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789118076.956633:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789118076.956862:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789118076.957181:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789118076.957422:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789118076.957646:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789118076.959313:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789118076.960118:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.960339:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.960553:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.960844:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.961091:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.961290:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.961528:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.961753:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.961979:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.962191:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.962428:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.962654:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.963084:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.963301:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.963500:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.963686:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.963880:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.964199:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.964464:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.964657:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.965001:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.965225:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.965449:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.965650:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.965848:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.966142:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.966387:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.966585:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.966784:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.967019:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789118076.967252:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.967463:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789118076.968905:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789118076.969353:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789118076.969545:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789118076.970080:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789118076.970272:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789118076.970479:0:23356:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1789118076.970937:0:23356:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789118076.971224:0:23356:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789118076.971232:0:23356:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789118076.971244:0:23356:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be213ba 00000020:01000004:2.0:1789118076.971250:0:23356:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789118076.971255:0:23356:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789118076.971260:0:23356:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962a8795a800 from MGS 00000020:01000004:2.0:1789118076.971264:0:23356:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789118076.971274:0:23356:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff962bbd009a48) 00000020:00000080:2.0:1789118076.971284:0:23356:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789118076.971351:0:23356:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962a8795a800 from MGS, refs=2 00080000:01000000:2.0:1789118076.971355:0:23356:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789118076.971378:0:23356:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be213c8 00000100:00100000:2.0:1789118076.971488:0:23356:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789118076.971631:0:23356:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789118076.971638:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789118076.972382:0:23356:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789118076.972389:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789118076.973356:0:23356:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789118076.973552:0:23356:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789118076.973558:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789118076.974209:0:23356:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789118076.974217:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789118076.974574:0:23356:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789118076.974580:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789118076.975389:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118076.975393:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118076.975395:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118076.976038:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118076.976046:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118076.976048:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118076.976808:0:23356:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:1.0:1789118076.981754:0:23356:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789118076.982781:0:23368:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789118076.982849:0:23356:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789118076.982901:0:23356:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789118076.983612:0:23356:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789118076.984024:0:23356:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789118076.984251:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789118076.984258:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:2.0:1789118076.984624:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789118076.985390:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789118076.985399:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789118076.997468:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789118076.997481:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789118077.001230:0:23356:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789118077.001259:0:23356:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.130@tcp' 00000020:01000004:1.0:1789118077.001261:0:23356:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789118077.001297:0:23356:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.130@tcp (typ=mgc) 00000020:00000080:1.0:1789118077.001313:0:23356:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.130@tcp (ffff962b88029a48) 00000020:00000080:1.0:1789118077.001330:0:23356:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789118077.001433:0:23356:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962a81b39800@MGC192.168.204.130@tcp: add connection 192.168.204.130@tcp at head 00010000:00010000:1.0:1789118077.001605:0:23356:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.130@tcp-0 is initialized 00000040:01000000:1.0:1789118077.001611:0:23356:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789118077.001869:0:23373:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789118077.014443:0:23375:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789118077.016496:0:23356:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.130@tcp (uuid bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b) 00000020:00000080:3.0:1789118077.016533:0:23356:0:(genops.c:1385:class_connect()) connect: client bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b, cookie 0xaa253ed19be213d6 00000100:00080000:3.0:1789118077.016548:0:23356:0:(import.c:510:import_select_connection()) MGC192.168.204.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789118077.016556:0:23356:0:(import.c:624:import_select_connection()) MGC192.168.204.130@tcp: import ffff962a81b39800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118077.016604:0:23356:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf724b40 x1876025593298048/t0(0) o250->MGC192.168.204.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789118077.016639:0:23356:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b->MGS 00000020:01000004:3.0:1789118077.016665:0:23356:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789118077.016672:0:23356:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789118077.016693:0:23356:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff962a88d1ced8) 00000020:00000080:3.0:1789118077.016711:0:23356:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789118077.017014:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3643:1876025593298048:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789118077.017159:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118077.017299:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593298048 00000100:00100000:2.0:1789118077.017307:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593298048 00000100:00100000:2.0:1789118077.017351:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789118077.017370:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1876025593298048:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789118077.017399:0:23369:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b@0@lo t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:2.0:1789118077.017428:0:23369:0:(genops.c:1385:class_connect()) connect: client bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b, cookie 0xaa253ed19be213e4 00000100:00080000:2.0:1789118077.017587:0:23369:0:(import.c:65:import_set_state_nolock()) ffff962b845e2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789118077.017644:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+5:3643:x1876025593298048:12345-0@lo:250:mount.lustre.0 Request processed in 285us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118077.017653:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789118077.020470:0:3643:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789118077.020498:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.130@tcp: connect to target with instance 0 00000100:00080000:0.0:1789118077.020513:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789118077.020522:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789118077.020529:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a81b39800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789118077.020533:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789118077.020551:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789118077.020564:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3643:1876025593298048:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789118077.035787:0:23356:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789118077.038289:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789118077.038300:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789118077.040669:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789118077.040687:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789118077.042190:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789118077.042202:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789118077.042878:0:23356:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789118077.043117:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789118077.043123:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789118077.043826:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789118077.043845:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789118077.096575:0:23356:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789118077.096801:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789118077.096808:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789118077.106374:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789118077.106390:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789118077.113803:0:23356:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789118077.116001:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789118077.116012:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789118077.124825:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789118077.124853:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789118077.125762:0:23356:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789118077.126025:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789118077.126031:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789118077.129376:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789118077.129397:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789118077.130542:0:23356:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789118077.130755:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789118077.130770:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789118077.131795:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789118077.131804:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789118077.177497:0:23356:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789118077.177898:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789118077.177907:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789118077.181721:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789118077.181738:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789118077.199935:0:23356:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789118077.199951:0:23356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789118077.210032:0:23356:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789118077.210708:0:23356:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789118077.210717:0:23356:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789118077.210940:0:23356:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789118077.210984:0:23356:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.130@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789118077.210989:0:23356:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789118077.210991:0:23356:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789118077.210993:0:23356:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789118077.210994:0:23356:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789118077.210995:0:23356:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789118077.210997:0:23356:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789118077.210998:0:23356:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789118077.211000:0:23356:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789118077.211001:0:23356:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789118077.211002:0:23356:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789118077.211005:0:23356:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789118077.211007:0:23356:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789118077.211008:0:23356:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789118077.211010:0:23356:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789118077.211011:0:23356:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789118077.211012:0:23356:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789118077.211013:0:23356:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789118077.211014:0:23356:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789118077.211016:0:23356:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789118077.211017:0:23356:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789118077.211018:0:23356:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789118077.211250:0:23356:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789118077.211276:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593298176:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789118077.211352:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118077.211451:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fa0900 going to sleep for 11 seconds 00000100:00100000:1.0:1789118077.221397:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593298176 00000100:00100000:1.0:1789118077.221420:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593298176 00000100:00100000:1.0:1789118077.221511:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789118077.221520:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+5:23356:x1876025593298176:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789118077.222265:0:23372:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789118077.222272:0:23372:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789118077.222276:0:23372:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789118077.226994:0:23393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789118077.230721:0:23372:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1789118077.233609:0:23394:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789118077.233619:0:23394:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1789118077.233622:0:23394:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789118077.233625:0:23394:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789118077.234006:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1789118077.234375:0:23372:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789118077.234389:0:23372:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789118077.236480:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+5:23356:x1876025593298176:12345-0@lo:253:mount.lustre.0 Request processed in 14953us (25120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118077.236494:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789118077.241139:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593298176:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789118077.241164:0:23356:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789118077.241168:0:23356:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789118077.241170:0:23356:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789118077.241171:0:23356:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789118077.241173:0:23356:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789118077.241174:0:23356:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789118077.241175:0:23356:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789118077.241177:0:23356:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789118077.241178:0:23356:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789118077.241180:0:23356:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789118077.241182:0:23356:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789118077.241215:0:23356:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962a8795a800 from lustre-MDT0000 10000000:01000000:3.0:1789118077.241251:0:23356:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789118077.241254:0:23356:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789118077.241259:0:23356:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff962b88029a48 10000000:01000000:3.0:1789118077.241264:0:23356:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789118077.241272:0:23356:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff962b88029a48 from 1 10000000:01000000:3.0:1789118077.241275:0:23356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789118077.241322:0:23356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.241334:0:23356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.241343:0:23356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118077.241396:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593298304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789118077.241482:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118077.241529:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fa0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789118077.242087:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593298304 00000100:00100000:1.0:1789118077.242096:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593298304 00000100:00100000:1.0:1789118077.242156:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789118077.242167:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+5:23356:x1876025593298304:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789118077.242184:0:23370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118077.242204:0:23370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70d400/0xaa253ed19be213f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be213eb expref: -99 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118077.242231:0:23370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70d400/0xaa253ed19be213f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be213eb expref: 6 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118077.242241:0:23370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70d400/0xaa253ed19be213f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be213eb expref: 6 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118077.242251:0:23370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d400, rc 0) 00000100:00100000:1.0:1789118077.242304:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+6:23356:x1876025593298304:12345-0@lo:101:mount.lustre.0 Request processed in 138us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118077.242311:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789118077.242569:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593298304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789118077.242589:0:23356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be213f2 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.242736:0:23356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be213f2 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118077.242945:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593298432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789118077.242984:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118077.243099:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fa0240 going to sleep for 11 seconds 00000100:00100000:2.0:1789118077.244295:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593298432 00000100:00100000:2.0:1789118077.244307:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593298432 00000100:00100000:3.0:1789118077.247448:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789118077.247463:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+6:23356:x1876025593298432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789118077.247619:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+6:23356:x1876025593298432:12345-0@lo:501:mount.lustre.0 Request processed in 160us (4634us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789118077.247627:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789118077.247759:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593298432:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789118077.247806:0:23356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789118077.247843:0:23356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be213f2 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.247856:0:23356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be213f2 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789118077.247867:0:23356:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962a8795a800 10000000:01000000:0.0:1789118077.247886:0:23356:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789118077.247892:0:23356:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff962a8795a800 10000000:01000000:0.0:1789118077.247895:0:23356:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789118077.247899:0:23356:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff962a8795a800 from 1 10000000:01000000:0.0:1789118077.247902:0:23356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789118077.247939:0:23356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee64600/0xaa253ed19be213f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.247949:0:23356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b8ee64600/0xaa253ed19be213f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.247959:0:23356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b8ee64600/0xaa253ed19be213f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118077.247986:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593298560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789118077.248031:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118077.248098:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880f6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789118077.248506:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593298560 00000100:00100000:3.0:1789118077.248514:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593298560 00000100:00100000:3.0:1789118077.248553:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789118077.248561:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+6:23356:x1876025593298560:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789118077.248573:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789118077.248601:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a88d9be00/0xaa253ed19be21400 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be213f9 expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.248636:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a88d9be00/0xaa253ed19be21400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be213f9 expref: 7 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.248646:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a88d9be00/0xaa253ed19be21400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be213f9 expref: 7 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.248654:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9be00, rc 0) 00000100:00100000:3.0:1789118077.248689:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+7:23356:x1876025593298560:12345-0@lo:101:mount.lustre.0 Request processed in 129us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118077.248695:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789118077.249273:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593298560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789118077.249294:0:23356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b8ee64600/0xaa253ed19be213f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21400 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.249305:0:23356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b8ee64600/0xaa253ed19be213f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21400 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789118077.249323:0:23356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789118077.249339:0:23356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee64600/0xaa253ed19be213f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21400 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.249346:0:23356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b8ee64600/0xaa253ed19be213f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21400 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789118077.249374:0:23356:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789118077.249378:0:23356:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789118077.249384:0:23356:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff962a8795a800 10000000:01000000:0.0:1789118077.249387:0:23356:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789118077.249391:0:23356:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789118077.249393:0:23356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789118077.249418:0:23356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee64a00/0xaa253ed19be21407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.249425:0:23356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b8ee64a00/0xaa253ed19be21407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.249432:0:23356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b8ee64a00/0xaa253ed19be21407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118077.249452:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593298688:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789118077.249493:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118077.249526:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880f6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789118077.249687:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593298688 00000100:00100000:3.0:1789118077.249691:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593298688 00000100:00100000:3.0:1789118077.249728:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789118077.249736:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+7:23356:x1876025593298688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789118077.249749:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789118077.249761:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a88d9aa00/0xaa253ed19be2140e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be21407 expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.249779:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a88d9aa00/0xaa253ed19be2140e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be21407 expref: 8 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.249788:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a88d9aa00/0xaa253ed19be2140e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be21407 expref: 8 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.249805:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9aa00, rc 0) 00000100:00100000:3.0:1789118077.249853:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+8:23356:x1876025593298688:12345-0@lo:101:mount.lustre.0 Request processed in 117us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118077.249860:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789118077.250274:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593298688:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789118077.250288:0:23356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b8ee64a00/0xaa253ed19be21407 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be2140e expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.250296:0:23356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b8ee64a00/0xaa253ed19be21407 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be2140e expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118077.250371:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593298816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789118077.250399:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118077.250439:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880f6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789118077.250502:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593298816 00000100:00100000:1.0:1789118077.250508:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593298816 00000100:00100000:1.0:1789118077.250548:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789118077.250557:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+8:23356:x1876025593298816:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789118077.250752:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+9:23356:x1876025593298816:12345-0@lo:501:mount.lustre.0 Request processed in 196us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118077.250760:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789118077.251100:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593298816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789118077.251139:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593298944:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789118077.251185:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118077.251223:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880f6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789118077.251394:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593298944 00000100:00100000:2.0:1789118077.251399:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593298944 00000100:00100000:2.0:1789118077.251441:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789118077.251450:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+9:23356:x1876025593298944:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789118077.252557:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+9:23356:x1876025593298944:12345-0@lo:503:mount.lustre.0 Request processed in 1098us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118077.252570:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789118077.252777:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593298944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789118077.254527:0:23395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23395:1876025593299072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789118077.254733:0:23395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118077.254850:0:23395:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb7503000 going to sleep for 11 seconds 00000100:00100000:3.0:1789118077.261029:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593299072 00000100:00100000:3.0:1789118077.261309:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593299072 00000100:00100000:3.0:1789118077.261399:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789118077.261410:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+9:23395:x1876025593299072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789118077.266239:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+9:23395:x1876025593299072:12345-0@lo:502:llog_process_th.0 Request processed in 4815us (11490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118077.266256:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789118077.266900:0:23395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23395:1876025593299072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789118077.266944:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789118077.266959:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118077.266962:0:23395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789118077.266967:0:23395:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789118077.266972:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789118077.266989:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff962b8802ced8) 00000020:00000080:1.0:1789118077.267011:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789118077.267017:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789118077.267156:0:23395:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789118077.267164:0:23395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be2141c 00000020:00000080:1.0:1789118077.267379:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789118077.267384:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789118077.267388:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118077.267390:0:23395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789118077.267392:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789118077.267395:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118077.267397:0:23395:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789118077.267400:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789118077.267409:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff962b8802b490) 00000020:00000080:1.0:1789118077.267418:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789118077.267422:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789118077.267423:0:23395:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789118077.267427:0:23395:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789118077.267433:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789118077.267493:0:23395:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962a8795a800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789118077.267510:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff962b88028000) 00000020:00000080:1.0:1789118077.267520:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789118077.267572:0:23395:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789118077.267584:0:23395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be21431 00000020:00000080:1.0:1789118077.267704:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789118077.267711:0:23395:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789118077.267716:0:23395:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xaa253ed19be21438 00080000:01000000:1.0:1789118077.267721:0:23395:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789118077.267724:0:23395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be2143f 00010000:00010000:2.0:1789118077.395416:0:23395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789118077.397422:0:23395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:2.0:1789118077.398532:0:23395:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789118077.399601:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff962bbd008000) 00000020:00000080:2.0:1789118077.399628:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789118077.399702:0:23395:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789118077.399710:0:23395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be2144d 00000020:00000080:3.0:1789118077.400914:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789118077.425456:0:23395:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xaa253ed19be21454 00000020:00000080:2.0:1789118077.425978:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789118077.425994:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789118077.426002:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.426005:0:23395:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789118077.426008:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789118077.426011:0:23395:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1789118077.426013:0:23395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789118077.426014:0:23395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789118077.426016:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789118077.426018:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.426019:0:23395:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789118077.426022:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789118077.426027:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.426029:0:23395:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789118077.426033:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789118077.426111:0:23395:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789118077.426249:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789118077.426254:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.426256:0:23395:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789118077.426258:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789118077.426262:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.426264:0:23395:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789118077.426266:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789118077.426271:0:23395:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:00000080:2.0:1789118077.426297:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789118077.426312:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff962bbd00ced8) 00000020:00000080:2.0:1789118077.426335:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789118077.426340:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789118077.426418:0:23395:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789118077.426424:0:23395:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789118077.426430:0:23395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be21462 00010000:00080000:2.0:1789118077.426463:0:23395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962a87fde800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1789118077.428316:0:23395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1789118077.434551:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789118077.434628:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789118077.434680:0:23395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789118077.434702:0:23395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be21469 00000100:00080000:3.0:1789118077.434714:0:23395:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789118077.434721:0:23395:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff962a87fde800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118077.434771:0:23395:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf725a40 x1876025593299200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789118077.434810:0:23395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1789118077.434872:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789118077.434877:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118077.434879:0:23395:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789118077.434882:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789118077.434885:0:23395:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1789118077.434887:0:23395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789118077.434888:0:23395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789118077.434889:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789118077.434892:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118077.434893:0:23395:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789118077.434902:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789118077.434908:0:23395:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789118077.434920:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118077.434922:0:23395:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789118077.434926:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789118077.434931:0:23395:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:3.0:1789118077.434960:0:23395:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789118077.434963:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789118077.434980:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff962a88d1b490) 00000020:00000080:3.0:1789118077.434993:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789118077.434997:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789118077.435077:0:23395:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789118077.435084:0:23395:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789118077.435089:0:23395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be21477 00010000:00080000:3.0:1789118077.435116:0:23395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bbce12800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.130@tcp at head 00000100:00100000:1.0:1789118077.435236:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf725a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593299200:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789118077.435315:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118077.435408:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593299200 00000100:00100000:2.0:1789118077.435418:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593299200 00000100:00100000:2.0:1789118077.435457:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789118077.435466:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593299200:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1789118077.435492:0:23382:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:3.0:1789118077.435819:0:23395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789118077.438794:0:23395:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789118077.439917:0:23395:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789118077.444313:0:23395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789118077.444917:0:23395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1789118077.446411:0:23395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1789118077.450741:0:23401:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789118077.450748:0:23401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789118077.457317:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789118077.457333:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789118077.457390:0:23395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789118077.457411:0:23395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be2147e 00000100:00080000:3.0:1789118077.457422:0:23395:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789118077.457428:0:23395:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff962bbce12800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118077.457464:0:23395:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf726580 x1876025593299328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789118077.457603:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf726580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593299328:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789118077.457663:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593299328 offset 0 length 520: 4 00000100:00080000:3.0:1789118077.457756:0:23395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789118077.457950:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789118077.457956:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118077.457971:0:23395:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789118077.457975:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789118077.457978:0:23395:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1789118077.457979:0:23395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789118077.457981:0:23395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789118077.457982:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789118077.457984:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118077.457986:0:23395:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789118077.457989:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789118077.457993:0:23395:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789118077.457998:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118077.457999:0:23395:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789118077.458002:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789118077.458007:0:23395:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:3.0:1789118077.458034:0:23395:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789118077.458037:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789118077.458243:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff962a88d19a48) 00000020:00000080:3.0:1789118077.458257:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1789118077.458265:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789118077.458337:0:23395:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789118077.458342:0:23395:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789118077.458366:0:23395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa253ed19be2148c 00010000:00080000:3.0:1789118077.458410:0:23395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962b90578800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:3.0:1789118077.458756:0:23395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789118077.458917:0:23395:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789118077.459002:0:23395:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789118077.465139:0:23395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789118077.470592:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593299200:12345-0@lo:38:llog_process_th.0 Request processed in 35117us (35269us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789118077.470606:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789118077.470895:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a87fde800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789118077.470902:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789118077.470906:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf725a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593299200:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789118077.473998:0:23395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1789118077.474314:0:23395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1789118077.475906:0:23403:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789118077.475915:0:23403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789118077.483153:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789118077.483171:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789118077.483237:0:23395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789118077.483259:0:23395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be21493 00000100:00080000:0.0:1789118077.483269:0:23395:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789118077.483276:0:23395:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b90578800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789118077.483316:0:23395:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87d9c000 x1876025593299456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789118077.483362:0:23395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789118077.483464:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118077.483469:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118077.483470:0:23395:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789118077.483473:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789118077.483477:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118077.483479:0:23395:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789118077.483481:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789118077.483483:0:23395:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789118077.483485:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118077.483488:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118077.483489:0:23395:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789118077.483492:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789118077.483494:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118077.483495:0:23395:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789118077.483514:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789118077.483549:0:23395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23395:1876025593299584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789118077.483627:0:23395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118077.483671:0:23395:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880f6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789118077.483802:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593299584 00000100:00100000:1.0:1789118077.483810:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593299584 00000100:00100000:2.0:1789118077.483818:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593299456:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789118077.483859:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593299456 offset 0 length 520: 4 00000100:00100000:1.0:1789118077.483859:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789118077.483868:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+9:23395:x1876025593299584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789118077.484031:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+9:23395:x1876025593299584:12345-0@lo:502:llog_process_th.0 Request processed in 162us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118077.484047:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789118077.484275:0:23395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23395:1876025593299584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789118077.484304:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789118077.484309:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.484310:0:23395:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789118077.484314:0:23395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789118077.485210:0:23356:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1789118077.485257:0:23356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789118077.485275:0:23356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee64a00/0xaa253ed19be21407 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be2140e expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.485287:0:23356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b8ee64a00/0xaa253ed19be21407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be2140e expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789118077.485296:0:23356:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962a8795a800 from 1 10000000:01000000:0.0:1789118077.485300:0:23356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789118077.485336:0:23356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.485345:0:23356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.485364:0:23356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118077.485390:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593299712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789118077.485439:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118077.485488:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880f63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789118077.485612:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593299712 00000100:00100000:2.0:1789118077.485619:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593299712 00000100:00100000:2.0:1789118077.485664:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789118077.485674:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+9:23356:x1876025593299712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789118077.485708:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118077.485723:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d93e00/0xaa253ed19be214a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be2149a expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.485745:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93e00/0xaa253ed19be214a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be2149a expref: 10 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.485756:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d93e00/0xaa253ed19be214a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2149a expref: 10 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.485764:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93e00, rc 0) 00000100:00100000:2.0:1789118077.485816:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+10:23356:x1876025593299712:12345-0@lo:101:mount.lustre.0 Request processed in 143us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118077.485823:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789118077.486717:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593299712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789118077.486737:0:23356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be214a1 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.486776:0:23356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be214a1 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118077.489452:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593299840:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789118077.489781:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118077.489971:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880f63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789118077.500990:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593299840 00000100:00100000:3.0:1789118077.501006:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593299840 00000100:00100000:3.0:1789118077.501098:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789118077.501112:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+10:23356:x1876025593299840:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789118077.501159:0:23372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789118077.501165:0:23372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789118077.501318:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+10:23356:x1876025593299840:12345-0@lo:256:mount.lustre.0 Request processed in 209us (11537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118077.501327:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789118077.501854:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593299840:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789118077.502529:0:23356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789118077.502554:0:23356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be214a1 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.502567:0:23356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be214a1 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789118077.502577:0:23356:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962a8795a800 from 1 10000000:01000000:0.0:1789118077.502579:0:23356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789118077.502627:0:23356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.502637:0:23356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.502649:0:23356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118077.502678:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593299968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789118077.502747:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118077.502853:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b880f63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789118077.502944:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593299968 00000100:00100000:3.0:1789118077.502951:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593299968 00000100:00100000:3.0:1789118077.503004:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789118077.503013:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+10:23356:x1876025593299968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789118077.503026:0:23370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789118077.503039:0:23370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a88d9a600/0xaa253ed19be214af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be214a8 expref: -99 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.503082:0:23370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a88d9a600/0xaa253ed19be214af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be214a8 expref: 11 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.503094:0:23370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a88d9a600/0xaa253ed19be214af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be214a8 expref: 11 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.503103:0:23370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9a600, rc 0) 00000100:00100000:3.0:1789118077.503162:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+11:23356:x1876025593299968:12345-0@lo:101:mount.lustre.0 Request processed in 149us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118077.503168:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789118077.503268:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593299968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789118077.503282:0:23356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be214af expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.503290:0:23356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be214af expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118077.503367:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593300096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789118077.503394:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118077.503420:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789118077.503550:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593300096 00000100:00100000:3.0:1789118077.503554:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593300096 00000100:00100000:3.0:1789118077.503586:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789118077.503592:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+11:23356:x1876025593300096:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789118077.503732:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+11:23356:x1876025593300096:12345-0@lo:501:mount.lustre.0 Request processed in 139us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118077.503747:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789118077.504314:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593300096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789118077.504367:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593300224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789118077.504423:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118077.504452:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789118077.504519:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593300224 00000100:00100000:0.0:1789118077.504525:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593300224 00000100:00100000:0.0:1789118077.504571:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789118077.504580:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+11:23356:x1876025593300224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789118077.504684:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+11:23356:x1876025593300224:12345-0@lo:503:mount.lustre.0 Request processed in 104us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118077.504691:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789118077.504930:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593300224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789118077.506682:0:23405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23405:1876025593300352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789118077.506790:0:23405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118077.506967:0:23405:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789118077.513449:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593300352 00000100:00100000:3.0:1789118077.513465:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593300352 00000100:00100000:3.0:1789118077.513533:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789118077.513543:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+11:23405:x1876025593300352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789118077.514126:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+11:23405:x1876025593300352:12345-0@lo:502:llog_process_th.0 Request processed in 581us (7333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118077.514136:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789118077.514337:0:23405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23405:1876025593300352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789118077.514397:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789118077.514411:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.514414:0:23405:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789118077.514422:0:23405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962a8795a800 00000020:00000080:2.0:1789118077.514425:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789118077.514435:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789118077.514437:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.514439:0:23405:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789118077.514441:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789118077.514443:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.514445:0:23405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789118077.514448:0:23405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962a8795a800 00000020:00000080:2.0:1789118077.514450:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789118077.514516:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789118077.514520:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.514522:0:23405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789118077.514525:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789118077.514528:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.514529:0:23405:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789118077.514532:0:23405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a8795a800 00000020:00000080:2.0:1789118077.514534:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789118077.514554:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789118077.514557:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.514558:0:23405:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789118077.514561:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789118077.514563:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.514571:0:23405:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789118077.514576:0:23405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a8795a800 00000020:00000080:2.0:1789118077.514578:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789118077.514595:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789118077.514598:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.514599:0:23405:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789118077.514601:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789118077.514603:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.514604:0:23405:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789118077.514607:0:23405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a8795a800 00000020:00000080:2.0:1789118077.514609:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789118077.514621:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789118077.514624:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.514625:0:23405:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789118077.514626:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789118077.514628:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.514629:0:23405:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789118077.514632:0:23405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a8795a800 00000020:00000080:2.0:1789118077.514634:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789118077.514679:0:23405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23405:1876025593300480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789118077.514728:0:23405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118077.514770:0:23405:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789118077.514806:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593300480 00000100:00100000:0.0:1789118077.514812:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593300480 00000100:00100000:0.0:1789118077.514853:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789118077.514861:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+11:23405:x1876025593300480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789118077.514976:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+11:23405:x1876025593300480:12345-0@lo:502:llog_process_th.0 Request processed in 116us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118077.514983:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789118077.515309:0:23405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23405:1876025593300480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789118077.515332:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789118077.515337:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118077.515339:0:23405:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789118077.515343:0:23405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:0.0:1789118077.515465:0:23356:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789118077.515510:0:23356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789118077.515536:0:23356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be214af expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.515549:0:23356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be214af expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789118077.515639:0:23356:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789118077.515642:0:23356:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962a8795a800 10000000:01000000:0.0:1789118077.515645:0:23356:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962a8795a800 10000000:01000000:0.0:1789118077.515649:0:23356:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789118077.515655:0:23356:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962a8795a800 from 1 10000000:01000000:0.0:1789118077.515658:0:23356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789118077.515709:0:23356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee64800/0xaa253ed19be214b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.515720:0:23356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b8ee64800/0xaa253ed19be214b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118077.515730:0:23356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b8ee64800/0xaa253ed19be214b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118077.515748:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593300608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789118077.515786:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118077.516423:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fa0900 going to sleep for 11 seconds 00000100:00100000:3.0:1789118077.519098:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593300608 00000100:00100000:3.0:1789118077.519114:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593300608 00000100:00100000:3.0:1789118077.519172:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789118077.519181:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+11:23356:x1876025593300608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789118077.519198:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789118077.519222:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a88d9b600/0xaa253ed19be214bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be214b6 expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.519258:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a88d9b600/0xaa253ed19be214bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be214b6 expref: 12 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.519270:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a88d9b600/0xaa253ed19be214bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be214b6 expref: 12 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.519279:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a88d9b600, rc 0) 00000100:00100000:3.0:1789118077.519375:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23356:x1876025593300608:12345-0@lo:101:mount.lustre.0 Request processed in 195us (3588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118077.519392:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789118077.519500:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593300608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789118077.519520:0:23356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b8ee64800/0xaa253ed19be214b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be214bd expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.519540:0:23356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b8ee64800/0xaa253ed19be214b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be214bd expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118077.519625:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593300736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789118077.519663:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118077.519707:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789118077.520034:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593300736 00000100:00100000:3.0:1789118077.520041:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593300736 00000100:00100000:3.0:1789118077.520107:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789118077.520116:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23356:x1876025593300736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789118077.520308:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23356:x1876025593300736:12345-0@lo:501:mount.lustre.0 Request processed in 193us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118077.520315:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789118077.520428:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593300736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789118077.520468:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593300864:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789118077.520521:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118077.520551:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789118077.520597:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593300864 00000100:00100000:3.0:1789118077.520601:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593300864 00000100:00100000:3.0:1789118077.520634:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789118077.520640:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23356:x1876025593300864:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789118077.520722:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23356:x1876025593300864:12345-0@lo:503:mount.lustre.0 Request processed in 82us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118077.520729:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789118077.520797:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593300864:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789118077.521369:0:23406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23406:1876025593300992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789118077.521414:0:23406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118077.521446:0:23406:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b886056c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789118077.521491:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593300992 00000100:00100000:3.0:1789118077.521496:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593300992 00000100:00100000:3.0:1789118077.521529:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789118077.521538:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23406:x1876025593300992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789118077.521631:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23406:x1876025593300992:12345-0@lo:502:llog_process_th.0 Request processed in 95us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118077.521639:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789118077.521680:0:23406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23406:1876025593300992:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789118077.521740:0:23406:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789118077.521756:0:23406:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff962a88d18000) 00000020:00000080:3.0:1789118077.521785:0:23406:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789118077.521888:0:23406:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962a8795a800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789118077.521893:0:23406:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962a8795a800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789118077.521896:0:23406:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962a8795a800 4 00010000:00080000:3.0:1789118077.521928:0:23406:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962b90dbb800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.130@tcp at head 00010000:00010000:3.0:1789118077.523640:0:23406:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789118077.523861:0:23406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789118077.523904:0:23406:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789118077.523916:0:23406:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xaa253ed19be214cb 00000100:00080000:3.0:1789118077.523929:0:23406:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789118077.523934:0:23406:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff962b90dbb800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118077.523971:0:23406:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf7270c0 x1876025593301120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789118077.524026:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593301120:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789118077.524126:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789118077.524172:0:23406:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789118077.528891:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593301120 00000100:00100000:2.0:1789118077.528907:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593301120 00000100:00100000:2.0:1789118077.528958:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789118077.528968:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf726d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593301120:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789118077.529107:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf726d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593301120:12345-0@lo:38:llog_process_th.0 Request processed in 139us (4979us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789118077.529115:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789118077.538914:0:23406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23406:1876025593301248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789118077.539010:0:23406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118077.539079:0:23406:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8319e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789118077.549438:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593301248 00000100:00100000:3.0:1789118077.549452:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593301248 00000100:00100000:3.0:1789118077.549512:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789118077.549522:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23406:x1876025593301248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789118077.549704:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23406:x1876025593301248:12345-0@lo:502:llog_process_th.0 Request processed in 183us (10694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118077.549712:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789118077.549928:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789118077.549936:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b90dbb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789118077.549939:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789118077.549943:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593301120:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789118077.550362:0:23406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23406:1876025593301248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789118077.550428:0:23406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23406:1876025593301376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789118077.550477:0:23406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118077.550505:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593301376 00000100:00100000:0.0:1789118077.550509:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593301376 00000100:00100000:0.0:1789118077.550541:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789118077.550548:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23406:x1876025593301376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789118077.550622:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23406:x1876025593301376:12345-0@lo:502:llog_process_th.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118077.550629:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789118077.550674:0:23406:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8319e780 going to sleep for 11 seconds 00000100:00100000:0.0:1789118077.550685:0:23406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23406:1876025593301376:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789118077.550709:0:23406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789118077.550912:0:23356:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789118077.550933:0:23356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789118077.550950:0:23356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee64800/0xaa253ed19be214b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be214bd expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.550961:0:23356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b8ee64800/0xaa253ed19be214b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be214bd expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789118077.551012:0:23356:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789118077.551014:0:23356:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789118077.551015:0:23356:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789118077.551017:0:23356:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789118077.551018:0:23356:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789118077.551020:0:23356:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789118077.551021:0:23356:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789118077.551023:0:23356:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789118077.551026:0:23356:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789118077.551027:0:23356:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789118077.551032:0:23356:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789118077.551034:0:23356:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789118077.551036:0:23356:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789118077.551037:0:23356:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789118077.551038:0:23356:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789118077.551039:0:23356:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789118077.551040:0:23356:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789118077.551041:0:23356:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789118077.551043:0:23356:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789118077.551044:0:23356:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789118077.551045:0:23356:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789118077.551084:0:23356:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789118077.551096:0:23356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593301504:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789118077.551131:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118077.551147:0:23356:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789118077.551171:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593301504 00000100:00100000:3.0:1789118077.551174:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593301504 00000100:00100000:3.0:1789118077.551966:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789118077.551974:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23356:x1876025593301504:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789118077.552101:0:23369:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789118077.552118:0:23369:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789118077.567772:0:23369:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789118077.567794:0:23369:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789118077.568077:0:23393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789118077.568084:0:23393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789118077.568116:0:23393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.568150:0:23393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d93e00/0xaa253ed19be214a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2149a expref: 12 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.568159:0:23393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.568224:0:23393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d93e00/0xaa253ed19be214a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be2149a expref: 12 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.568240:0:23393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962a87d93e00/0xaa253ed19be214a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be2149a expref: 12 pid: 23369 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118077.568257:0:23393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6a940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23393:1876025593301632:0@lo:104: 00000100:00100000:2.0:1789118077.568342:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118077.568400:0:23393:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b886050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789118077.568453:0:23360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593301632 00000100:00100000:2.0:1789118077.568463:0:23360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593301632 00000100:00100000:2.0:1789118077.568520:0:23360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789118077.568530:0:23360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+3:23393:x1876025593301632:12345-0@lo:104: 00010000:00010000:2.0:1789118077.568547:0:23360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be214a1 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.568604:0:23360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789118077.568611:0:23360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+3:23393:x1876025593301632:12345-0@lo:104: Request processed in 82us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118077.568619:0:23360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789118077.568662:0:23393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6a940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23393:1876025593301632:0@lo:104: 00010000:00010000:2.0:1789118077.568687:0:23393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.568933:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789118077.568942:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be214a1 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.568950:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b8ee65a00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789118077.568954:0:23366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be214a1 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.568964:0:23366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be214a1 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789118077.568971:0:23366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be214a1 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118077.568977:0:23366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789118077.569011:0:23366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be214a1 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.569017:0:23366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789118077.569046:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be214a1 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.569073:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b8ee65a00/0xaa253ed19be2149a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be214a1 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118077.569099:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118077.569101:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118077.569103:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118077.569145:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593301760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789118077.569439:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23356:x1876025593301504:12345-0@lo:253:mount.lustre.0 Request processed in 17465us (18306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118077.569451:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789118077.569521:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118077.569632:0:23356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23356:1876025593301504:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789118077.569645:0:23356:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789118077.569650:0:23356:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789118077.569651:0:23356:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789118077.569653:0:23356:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789118077.569655:0:23356:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789118077.569656:0:23356:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789118077.569657:0:23356:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789118077.569659:0:23356:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789118077.569660:0:23356:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789118077.569663:0:23356:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789118077.569665:0:23356:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789118077.569681:0:23356:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789118077.582854:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593301760 00000100:00100000:2.0:1789118077.582870:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593301760 00010000:00010000:2.0:1789118077.582915:0:23362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d93e00/0xaa253ed19be214a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be2149a expref: 12 pid: 23369 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118077.582953:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789118077.582962:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:3647:x1876025593301760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789118077.582977:0:23362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789118077.582983:0:23362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d93e00/0xaa253ed19be214a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be2149a expref: 12 pid: 23369 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.582997:0:23362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d93e00/0xaa253ed19be214a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be2149a expref: 12 pid: 23369 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.583017:0:23362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d93e00/0xaa253ed19be214a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be2149a expref: 12 pid: 23369 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.583034:0:23362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.583043:0:23362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789118077.583079:0:23362:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014996713s 00010000:00010000:2.0:1789118077.583085:0:23362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.583099:0:23362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.583107:0:23362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.583115:0:23362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.583121:0:23362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118077.583126:0:23362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.583134:0:23362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.583149:0:23362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.583161:0:23362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789118077.583505:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+11:3647:x1876025593301760:12345-0@lo:103:ldlm_bl.0 Request processed in 543us (13981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118077.583513:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789118077.583565:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593301760:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789118077.583601:0:23393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.583609:0:23393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118077.583624:0:23393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d93400/0xaa253ed19be214d2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789118077.643617:0:23356:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:2.0:1789118077.644476:0:23356:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789118077.647989:0:23418:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:1.0:1789118077.648003:0:23418:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:1.0:1789118077.648385:0:23419:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789118077.648747:0:23356:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1789118077.648910:0:23419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789118077.651192:0:23419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789118077.651312:0:23419:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1789118077.657266:0:23356:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789118077.657316:0:23356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789118077.657768:0:23356:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789118077.657777:0:23356:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789118077.657815:0:23356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789118077.658874:0:23356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00080000:3.0:1789118077.660262:0:23420:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff962bbf7270c0 x1876025593301888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118077.660276:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00000040:00080000:2.0:1789118077.663137:0:23356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789118077.664239:0:23356:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789118077.668475:0:23356:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1789118077.669101:0:23356:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1789118077.672173:0:23356:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1789118077.677021:0:23356:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789118077.677116:0:23356:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc5cc146f988 00100000:10000000:2.0:1789118077.677127:0:23356:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789118077.678127:0:23356:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789118077.678145:0:23356:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789118077.678166:0:23356:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789118077.678317:0:23356:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789118077.681684:0:23356:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789118077.683407:0:23356:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789118077.990462:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789118078.182129:0:23375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789118078.182137:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962a8795a800 from 11 10000000:01000000:3.0:1789118078.182142:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789118078.182187:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118078.182209:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118078.182222:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118078.182261:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7261c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593302016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789118078.182331:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118078.182387:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb840 going to sleep for 11 seconds 00000100:00100000:0.0:1789118078.182467:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593302016 00000100:00100000:0.0:1789118078.182473:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593302016 00000100:00100000:0.0:1789118078.182529:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789118078.182538:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+11:23375:x1876025593302016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789118078.182549:0:23370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789118078.182563:0:23370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b8ee64000/0xaa253ed19be214e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be214d9 expref: -99 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118078.182585:0:23370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b8ee64000/0xaa253ed19be214e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be214d9 expref: 12 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118078.182594:0:23370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b8ee64000/0xaa253ed19be214e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be214d9 expref: 12 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118078.182603:0:23370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b8ee64000, rc 0) 00000100:00100000:0.0:1789118078.182647:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23375:x1876025593302016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118078.182654:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789118078.182736:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7261c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593302016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789118078.182750:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be214e0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118078.182759:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be214e0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118078.182812:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7261c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593302144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789118078.182850:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118078.182875:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb840 going to sleep for 11 seconds 00000100:00100000:0.0:1789118078.182969:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593302144 00000100:00100000:0.0:1789118078.182974:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593302144 00000100:00100000:0.0:1789118078.183004:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789118078.183011:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23375:x1876025593302144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789118078.183024:0:23369:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789118078.183039:0:23369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789118078.183042:0:23369:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1789118078.183146:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:23375:x1876025593302144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118078.183158:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789118078.183428:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7261c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593302144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789118078.183477:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789118078.183485:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be214e0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118078.183495:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be214e0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789118078.630866:0:23413:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789118078.630878:0:23413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789118078.632093:0:23413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789118078.632102:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789118078.693138:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789118079.013429:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789118079.653285:0:23413:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789118079.653299:0:23413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789118079.653469:0:23413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1789118079.653503:0:23413:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789118079.667130:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1789118079.719320:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789118080.037195:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118080.747185:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789118081.061308:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118081.778385:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789118082.086176:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118082.789684:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00000100:00080000:3.0:1789118082.918261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789118082.918269:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789118082.918273:0:36:0:(import.c:65:import_set_state_nolock()) ffff962a87fde800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789118082.918281:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 729 00000100:00080000:3.0:1789118082.918286:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789118082.918292:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff962a87fde800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118082.918314:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf727480 x1876025593302400/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789118082.918329:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118082.918385:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789118082.918387:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118082.918390:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789118082.918392:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789118082.918395:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789118082.918397:0:36:0:(import.c:65:import_set_state_nolock()) ffff962b90dbb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789118082.918401:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff962b90dbb800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118082.918414:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf7243c0 x1876025593302528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789118082.918464:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593302272:0@lo:400:kworker.0 00000100:00100000:3.0:1789118082.918549:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118082.918801:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593302272 00000100:00100000:3.0:1789118082.918809:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593302272 00000100:00100000:3.0:1789118082.918855:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789118082.918863:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:3644:x1876025593302272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118082.918916:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:3644:x1876025593302272:12345-0@lo:400:kworker.0 Request processed in 54us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118082.918923:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789118082.918967:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593302400:0@lo:38:kworker.0 00000100:00100000:3.0:1789118082.918995:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118082.919023:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593302528:0@lo:38:kworker.0 00000100:00100000:3.0:1789118082.919044:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118082.919107:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593302272:0@lo:400:kworker.0 00000100:00100000:3.0:1789118082.919155:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593302528 00000100:00100000:3.0:1789118082.919159:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593302528 00000100:00100000:3.0:1789118082.919177:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789118082.919182:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf725680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876025593302528:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789118082.919203:0:23379:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:3.0:1789118082.919234:0:23379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xaa253ed19be214e7 00000004:00100000:3.0:1789118082.919259:0:23379:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789118082.919390:0:23379:0:(import.c:65:import_set_state_nolock()) ffff962bb5c49000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789118082.919428:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf725680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876025593302528:12345-0@lo:38:kworker.0 Request processed in 244us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118082.919435:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789118082.919465:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff962bbf7243c0 x1876025593302528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789118092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789118082.919486:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789118082.919493:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789118082.919497:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789118082.919499:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b90dbb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789118082.919505:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876025593302528:0@lo:38:kworker.0 00000100:00100000:3.0:1789118082.919571:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593302400 00000100:00100000:3.0:1789118082.919575:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593302400 00000100:00100000:2.0:1789118082.920091:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789118082.920098:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf724f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593302400:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789118082.920110:0:23382:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789118082.920162:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf724f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593302400:12345-0@lo:38:kworker.0 Request processed in 62us (1164us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789118082.920169:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789118082.920922:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a87fde800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789118082.920929:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789118082.920932:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593302400:0@lo:38:kworker.0 00010000:00010000:0.0:1789118083.113111:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789118083.278527:0:23663:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789118083.813220:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789118084.133195:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789118084.535529:0:23716:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789118084.535733:0:23716:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789118084.844508:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789118085.162475:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789118085.697127:0:23767:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789118085.697350:0:23767:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789118085.861384:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789118086.188877:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118086.886143:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00000100:00100000:3.0:1789118087.014720:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789118077/real 1789118077] req@ffff962a87d9c000 x1876025593299456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118087 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118087.014756:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962a87d9c000 x1876025593299456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118087 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118087.014767:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789118077/real 1789118077] req@ffff962bbf726580 x1876025593299328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118087 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118087.014778:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962bbf726580 x1876025593299328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118087 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789118087.014797:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b90578800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789118087.014850:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789118087.014855:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593299456:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789118087.014862:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbce12800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789118087.016503:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789118087.016510:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789118087.016513:0:37:0:(import.c:65:import_set_state_nolock()) ffff962a87fde800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789118087.016520:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 735 00000100:00080000:0.0:1789118087.016525:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789118087.016532:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff962a87fde800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789118087.016554:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87d9e940 x1876025593302784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789118087.016565:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118087.016578:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789118087.016579:0:37:0:(import.c:65:import_set_state_nolock()) ffff962bbce12800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789118087.016583:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 729 00000100:00080000:0.0:1789118087.016585:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789118087.016588:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff962bbce12800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789118087.016600:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87d9f840 x1876025593302912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789118087.016609:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118087.016612:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789118087.016614:0:37:0:(import.c:65:import_set_state_nolock()) ffff962b90578800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789118087.016617:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 729 00000100:00080000:0.0:1789118087.016620:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789118087.016623:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b90578800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789118087.016632:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87d9cb40 x1876025593303040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789118087.016695:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593303168:0@lo:400:kworker.0 00000100:00100000:0.0:1789118087.016766:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118087.016844:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593303168 00000100:00100000:0.0:1789118087.016851:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593303168 00000100:00100000:0.0:1789118087.016887:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789118087.016895:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593303168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118087.016939:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593303168:12345-0@lo:400:kworker.0 Request processed in 44us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118087.016959:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789118087.016995:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff962a87d9de00 x1876025593303168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118087.017012:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593303168:0@lo:400:kworker.0 00000100:00100000:0.0:1789118087.017294:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789118087.017305:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593302656:0@lo:400:kworker.0 00000100:00100000:0.0:1789118087.017339:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118087.018427:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593302656 00000100:00100000:2.0:1789118087.018437:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593302656 00000100:00100000:2.0:1789118087.018491:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789118087.018500:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:3644:x1876025593302656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118087.018564:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:3644:x1876025593302656:12345-0@lo:400:kworker.0 Request processed in 66us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118087.018570:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789118087.029653:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789118087.029667:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf726580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593299328:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789118087.029724:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593302784:0@lo:38:kworker.0 00000100:00100000:3.0:1789118087.029867:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118087.029906:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593302912:0@lo:8:kworker.0 00000400:00000100:3.0:1789118087.029930:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593302912 offset 0 length 520: 4 00000100:00100000:3.0:1789118087.029965:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593303040:0@lo:8:kworker.0 00000400:00000100:3.0:1789118087.029988:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593303040 offset 0 length 520: 4 00000100:00100000:3.0:1789118087.030032:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593302784 00000100:00100000:3.0:1789118087.030043:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593302784 00000100:00100000:3.0:1789118087.030115:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789118087.030124:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf726580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593302784:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789118087.030153:0:23382:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789118087.030219:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf726580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593302784:12345-0@lo:38:kworker.0 Request processed in 93us (351us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789118087.030229:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789118087.030304:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a87fde800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789118087.030309:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789118087.030313:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593302784:0@lo:38:kworker.0 00000100:00100000:0.0:1789118087.031256:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593302656:0@lo:400:kworker.0 00010000:00010000:3.0:1789118087.207289:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118087.909194:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789118088.230451:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118088.948425:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789118089.261939:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789118089.900047:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789118089.959828:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789118090.277492:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118090.984669:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789118091.305438:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118092.007148:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00000100:00080000:0.0:1789118092.135444:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789118092.135456:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789118092.135462:0:37:0:(import.c:65:import_set_state_nolock()) ffff962a87fde800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789118092.135473:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 739 00000100:00080000:0.0:1789118092.135481:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789118092.135490:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff962a87fde800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789118092.135513:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87d9d2c0 x1876025593303424/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789118092.135530:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118092.135534:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789118092.135536:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118092.135539:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789118092.135575:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789118092.135591:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593303296:0@lo:400:kworker.0 00000100:00100000:0.0:1789118092.135705:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118092.135740:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593303424:0@lo:38:kworker.0 00000100:00100000:0.0:1789118092.135804:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593303552:0@lo:400:kworker.0 00000100:00100000:2.0:1789118092.142161:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593303296 00000100:00100000:2.0:1789118092.142177:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593303296 00000100:00100000:2.0:1789118092.142238:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789118092.142249:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:3646:x1876025593303296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118092.144183:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118092.153391:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118092.153547:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593303552 00000100:00100000:3.0:1789118092.153571:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593303552 00000100:00100000:3.0:1789118092.153713:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789118092.153728:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593303552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118092.153868:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593303552:12345-0@lo:400:kworker.0 Request processed in 142us (9692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118092.153878:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789118092.153921:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593303424 00000100:00100000:3.0:1789118092.153927:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593303424 00000100:00100000:3.0:1789118092.153963:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789118092.153968:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf727c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593303424:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789118092.153993:0:23382:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789118092.155819:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf727c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593303424:12345-0@lo:38:kworker.0 Request processed in 1831us (2425us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789118092.155841:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789118092.155990:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff962a87d9e940 x1876025593303552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118092.156011:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593303552:0@lo:400:kworker.0 00000100:00100000:2.0:1789118092.157008:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:3646:x1876025593303296:12345-0@lo:400:kworker.0 Request processed in 14751us (21294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118092.157024:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789118092.157456:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593303296:0@lo:400:kworker.0 00000100:00080000:2.0:1789118092.160712:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a87fde800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789118092.160727:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789118092.160733:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593303424:0@lo:38:kworker.0 00010000:00010000:2.0:1789118092.327549:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118093.029176:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789118093.350135:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118094.053227:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789118094.386115:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789118095.019035:0:24112:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789118095.019047:0:24112:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789118095.019049:0:24112:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789118095.019234:0:24112:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff962bbf6a7800 00000020:01000004:2.0:1789118095.019271:0:24112:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789118095.019284:0:24112:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789118095.019301:0:24112:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff962bbd00b490) 00000020:00000080:2.0:1789118095.019320:0:24112:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1789118095.078674:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00100000:10000000:2.0:1789118095.161704:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789118095.162596:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789118095.165329:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789118095.165603:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789118095.165861:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789118095.166118:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1789118095.167259:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789118095.167784:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1789118095.168101:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1789118095.168419:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789118095.168966:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789118095.169366:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789118095.169618:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789118095.169921:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789118095.170181:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1789118095.170431:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789118095.174621:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789118095.175406:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789118095.175881:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789118095.176383:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789118095.181401:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1789118095.181998:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789118095.182354:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789118095.182681:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789118095.182974:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1789118095.183993:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789118095.185107:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789118095.186991:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789118095.187773:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789118095.188166:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789118095.188372:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789118095.188641:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1789118095.189226:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789118095.189441:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789118095.197848:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789118095.198272:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789118095.198792:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789118095.199819:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789118095.200579:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789118095.201264:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789118095.201550:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789118095.204691:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1789118095.206093:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1789118095.207668:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1789118095.208051:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789118095.208366:0:24112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1789118095.210570:0:24112:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789118095.210870:0:24112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789118095.210882:0:24112:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789118095.210894:0:24112:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be214f5 00000020:01000004:0.0:1789118095.210902:0:24112:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789118095.210929:0:24112:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789118095.210933:0:24112:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789118095.210941:0:24112:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789118095.210972:0:24112:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789118095.210978:0:24112:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789118095.216905:0:24112:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789118095.216945:0:24112:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.130@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789118095.216950:0:24112:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789118095.216952:0:24112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789118095.216953:0:24112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789118095.216954:0:24112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789118095.216955:0:24112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789118095.216957:0:24112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789118095.216958:0:24112:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789118095.216960:0:24112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789118095.216962:0:24112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789118095.216966:0:24112:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789118095.216968:0:24112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789118095.216969:0:24112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789118095.216970:0:24112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789118095.216971:0:24112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789118095.216972:0:24112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789118095.216973:0:24112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789118095.216974:0:24112:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789118095.216975:0:24112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789118095.216976:0:24112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789118095.217010:0:24112:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789118095.217050:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593303680:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789118095.217158:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118095.217210:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89b6b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789118095.217324:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593303680 00000100:00100000:1.0:1789118095.217335:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593303680 00000100:00100000:1.0:1789118095.217481:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789118095.217503:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:24112:x1876025593303680:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789118095.217543:0:23369:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789118095.217546:0:23369:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1789118095.217558:0:23369:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789118095.217987:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:24112:x1876025593303680:12345-0@lo:253:mount.lustre.0 Request processed in 495us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118095.217996:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789118095.218120:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593303680:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789118095.218134:0:24112:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789118095.218137:0:24112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789118095.218139:0:24112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789118095.218141:0:24112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789118095.218141:0:24112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789118095.218143:0:24112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789118095.218144:0:24112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789118095.218145:0:24112:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789118095.218147:0:24112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789118095.218149:0:24112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789118095.218181:0:24112:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962bbf6a7800 from lustre-MDT0001 10000000:01000000:0.0:1789118095.218213:0:24112:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789118095.218216:0:24112:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789118095.218223:0:24112:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962b88029a48 local copy 00010000:00010000:0.0:1789118095.218234:0:24112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be213f2 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118095.218405:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593303808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789118095.218439:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118095.219153:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89b6b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789118095.219274:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593303808 00000100:00100000:2.0:1789118095.219284:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593303808 00000100:00100000:3.0:1789118095.219464:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789118095.219474:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:24112:x1876025593303808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789118095.219587:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:24112:x1876025593303808:12345-0@lo:501:mount.lustre.0 Request processed in 115us (1147us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789118095.219606:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789118095.219683:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593303808:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789118095.219704:0:24112:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789118095.219741:0:24112:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789118095.219749:0:24112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be213f2 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118095.219773:0:24112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be213f2 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789118095.219809:0:24112:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962bbf6a7800 10000000:01000000:0.0:1789118095.219815:0:24112:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789118095.219821:0:24112:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff962b88029a48 10000000:01000000:0.0:1789118095.219824:0:24112:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789118095.219829:0:24112:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff962b88029a48 from 1 10000000:01000000:0.0:1789118095.219833:0:24112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789118095.219878:0:24112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee65e00/0xaa253ed19be214fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118095.219886:0:24112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b8ee65e00/0xaa253ed19be214fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118095.219898:0:24112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b8ee65e00/0xaa253ed19be214fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118095.219921:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593303936:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789118095.219960:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118095.225724:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593303936 00000100:00100000:1.0:1789118095.225748:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593303936 00000100:00100000:1.0:1789118095.225874:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789118095.225888:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+12:24112:x1876025593303936:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789118095.225910:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118095.225940:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70c800/0xaa253ed19be21503 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be214fc expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.225978:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70c800/0xaa253ed19be21503 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be214fc expref: 13 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.226009:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70c800/0xaa253ed19be21503 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be214fc expref: 13 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.226032:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c800, rc 0) 00000100:00100000:1.0:1789118095.226142:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+13:24112:x1876025593303936:12345-0@lo:101:mount.lustre.0 Request processed in 257us (6180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118095.226150:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789118095.228639:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89b6b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789118095.228690:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593303936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789118095.228774:0:24112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b8ee65e00/0xaa253ed19be214fc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21503 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118095.228791:0:24112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b8ee65e00/0xaa253ed19be214fc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21503 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789118095.228929:0:24112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789118095.229000:0:24112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee65e00/0xaa253ed19be214fc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21503 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118095.229009:0:24112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b8ee65e00/0xaa253ed19be214fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21503 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789118095.229036:0:24112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff962bbf6a7800 10000000:01000000:0.0:1789118095.229045:0:24112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789118095.229051:0:24112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff962bbf6a7800 from 1 10000000:01000000:0.0:1789118095.229085:0:24112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789118095.229128:0:24112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee65800/0xaa253ed19be2150a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118095.229136:0:24112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b8ee65800/0xaa253ed19be2150a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118095.229145:0:24112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b8ee65800/0xaa253ed19be2150a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118095.229169:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593304064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789118095.229241:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118095.229261:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89b6b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789118095.229379:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593304064 00000100:00100000:1.0:1789118095.229391:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593304064 00000100:00100000:1.0:1789118095.229470:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789118095.229484:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+13:24112:x1876025593304064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789118095.229512:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118095.229531:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70da00/0xaa253ed19be21511 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be2150a expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.229559:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70da00/0xaa253ed19be21511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be2150a expref: 14 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.229575:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70da00/0xaa253ed19be21511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2150a expref: 14 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.229585:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70da00, rc 0) 00000100:00100000:1.0:1789118095.229685:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+14:24112:x1876025593304064:12345-0@lo:101:mount.lustre.0 Request processed in 204us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118095.229695:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789118095.230291:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593304064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789118095.230810:0:24112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b8ee65800/0xaa253ed19be2150a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21511 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118095.230822:0:24112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b8ee65800/0xaa253ed19be2150a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21511 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789118095.230936:0:24112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789118095.231032:0:24112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee65800/0xaa253ed19be2150a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21511 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118095.231042:0:24112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b8ee65800/0xaa253ed19be2150a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21511 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789118095.231051:0:24112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789118095.231092:0:24112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789118095.231100:0:24112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff962bbf6a7800 10000000:01000000:0.0:1789118095.231103:0:24112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789118095.231108:0:24112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789118095.231111:0:24112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789118095.231142:0:24112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee65400/0xaa253ed19be21518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118095.231150:0:24112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b8ee65400/0xaa253ed19be21518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118095.231159:0:24112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b8ee65400/0xaa253ed19be21518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118095.231182:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593304192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789118095.231241:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118095.231274:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b89b6b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789118095.231488:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593304192 00000100:00100000:1.0:1789118095.231503:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593304192 00000100:00100000:1.0:1789118095.231566:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789118095.231575:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+14:24112:x1876025593304192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789118095.231588:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118095.231600:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70ce00/0xaa253ed19be2151f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be21518 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.231619:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70ce00/0xaa253ed19be2151f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be21518 expref: 15 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.231628:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70ce00/0xaa253ed19be2151f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be21518 expref: 15 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.231635:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70ce00, rc 0) 00000100:00100000:1.0:1789118095.231943:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+15:24112:x1876025593304192:12345-0@lo:101:mount.lustre.0 Request processed in 369us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118095.231950:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789118095.232644:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593304192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789118095.232667:0:24112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b8ee65400/0xaa253ed19be21518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be2151f expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118095.232695:0:24112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b8ee65400/0xaa253ed19be21518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be2151f expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789118095.237331:0:24112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1789118095.238280:0:24112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789118095.243138:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789118095.243215:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1789118095.243234:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1789118095.243248:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1789118095.243262:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1789118095.243276:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1789118095.243290:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1789118095.243303:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1789118095.243318:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1789118095.243334:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1789118095.243347:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1789118095.243361:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1789118095.243376:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1789118095.243388:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1789118095.243402:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1789118095.243415:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1789118095.243429:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1789118095.243443:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1789118095.243457:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1789118095.243470:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1789118095.243485:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1789118095.243670:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1789118095.243689:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1789118095.243702:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1789118095.244646:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1789118095.244695:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1789118095.244828:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1789118095.244846:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1789118095.244862:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1789118095.244877:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1789118095.244891:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1789118095.244907:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1789118095.244923:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1789118095.244939:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1789118095.244956:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1789118095.244972:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1789118095.245007:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1789118095.245041:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1789118095.245080:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1789118095.245096:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1789118095.245111:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1789118095.245125:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1789118095.245140:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1789118095.245156:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1789118095.245191:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1789118095.245197:0:24112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1789118095.245316:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593304320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789118095.245390:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118095.245593:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b900196c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789118095.248982:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593304320 00000100:00100000:1.0:1789118095.248997:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593304320 00000100:00100000:1.0:1789118095.249094:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789118095.249106:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+15:24112:x1876025593304320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789118095.249377:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+15:24112:x1876025593304320:12345-0@lo:501:mount.lustre.0 Request processed in 273us (3985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118095.249386:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789118095.249507:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593304320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789118095.249563:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593304448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789118095.249633:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118095.249675:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b900196c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789118095.249793:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593304448 00000100:00100000:1.0:1789118095.249799:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593304448 00000100:00100000:1.0:1789118095.249836:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789118095.249844:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+15:24112:x1876025593304448:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789118095.250678:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+15:24112:x1876025593304448:12345-0@lo:503:mount.lustre.0 Request processed in 832us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118095.250696:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789118095.250807:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593304448:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789118095.251345:0:24112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789118095.251434:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593304576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789118095.251488:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118095.251606:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b90019c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789118095.251838:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593304576 00000100:00100000:1.0:1789118095.251847:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593304576 00000100:00100000:1.0:1789118095.251954:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789118095.251966:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+15:24112:x1876025593304576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118095.259219:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+15:24112:x1876025593304576:12345-0@lo:502:mount.lustre.0 Request processed in 7241us (7716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118095.259236:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789118095.259671:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593304576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789118095.260280:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789118095.260434:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1789118095.260451:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1789118095.260466:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1789118095.260481:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1789118095.260564:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1789118095.260587:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1789118095.260600:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1789118095.260612:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1789118095.260627:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1789118095.260669:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1789118095.260685:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1789118095.260697:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1789118095.260711:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1789118095.260725:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1789118095.260738:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1789118095.260750:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1789118095.260764:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1789118095.260778:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1789118095.260789:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1789118095.260801:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1789118095.260814:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1789118095.260825:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1789118095.260838:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1789118095.260851:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1789118095.260864:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1789118095.260891:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1789118095.260906:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1789118095.260918:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1789118095.260931:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1789118095.260955:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1789118095.260968:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1789118095.260982:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1789118095.260995:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1789118095.261007:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1789118095.261036:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1789118095.261050:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1789118095.261089:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1789118095.261104:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1789118095.261118:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1789118095.261129:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1789118095.261142:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1789118095.261172:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1789118095.261187:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1789118095.261246:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593304704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789118095.265842:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118095.265919:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b831df240 going to sleep for 11 seconds 00000100:00100000:1.0:1789118095.266334:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593304704 00000100:00100000:1.0:1789118095.266344:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593304704 00000100:00100000:1.0:1789118095.266408:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789118095.266421:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+15:24112:x1876025593304704:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118095.266813:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+15:24112:x1876025593304704:12345-0@lo:502:mount.lustre.0 Request processed in 393us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118095.266823:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789118095.267376:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593304704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789118095.267654:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1789118095.267673:0:24112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789118095.271397:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789118095.271411:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118095.271414:0:24116:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789118095.271420:0:24116:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789118095.271423:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789118095.271440:0:24116:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff962a87e23490) 00000020:00000080:1.0:1789118095.271462:0:24116:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789118095.271466:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789118095.271669:0:24116:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789118095.271677:0:24116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be2152d 00000020:00000080:1.0:1789118095.272385:0:24116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789118095.272393:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789118095.272398:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118095.272413:0:24116:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789118095.272418:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789118095.272423:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118095.272425:0:24116:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789118095.272431:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789118095.272441:0:24116:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff962a87e21a48) 00000020:00000080:1.0:1789118095.272455:0:24116:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789118095.272459:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789118095.272461:0:24116:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789118095.272464:0:24116:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789118095.272470:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789118095.281364:0:24116:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962bbf6a7800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789118095.281398:0:24116:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff962bbd2b4ed8) 00000020:00000080:0.0:1789118095.281419:0:24116:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1789118095.281877:0:24116:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789118095.281886:0:24116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be21542 00000020:00000080:0.0:1789118095.282409:0:24116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789118095.282420:0:24116:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789118095.282424:0:24116:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xaa253ed19be21549 00080000:01000000:0.0:1789118095.282433:0:24116:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789118095.282439:0:24116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be21550 00010000:00010000:2.0:1789118095.398809:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118095.424986:0:24116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789118095.430045:0:24116:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1789118095.430983:0:24116:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789118095.446477:0:24116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789118095.446627:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789118095.446635:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118095.446637:0:24116:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789118095.446641:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789118095.446646:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118095.446648:0:24116:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789118095.446651:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789118095.446656:0:24116:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:00000080:3.0:1789118095.446688:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789118095.446708:0:24116:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff962bbfacced8) 00000020:00000080:3.0:1789118095.446746:0:24116:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1789118095.446755:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789118095.446834:0:24116:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789118095.446841:0:24116:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789118095.446847:0:24116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be2155e 00010000:00080000:3.0:1789118095.446883:0:24116:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962a88716000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:3.0:1789118095.455669:0:24116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1789118095.466386:0:24116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789118095.466406:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789118095.466457:0:24116:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789118095.467133:0:24116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be21565 00000100:00080000:3.0:1789118095.467747:0:24116:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789118095.467756:0:24116:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff962a88716000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118095.467799:0:24116:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf724780 x1876025593304832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789118095.467882:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593304832:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789118095.467965:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118095.469434:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593304832 00000100:00100000:3.0:1789118095.469447:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593304832 00000100:00100000:3.0:1789118095.469631:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789118095.469641:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593304832:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789118095.469672:0:23382:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 747 last 0 00000020:00000080:3.0:1789118095.469714:0:23382:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be2156c 00000004:00100000:3.0:1789118095.469731:0:23382:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789118095.469765:0:23382:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1789118095.469840:0:24116:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789118095.469881:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789118095.469886:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789118095.469890:0:37:0:(import.c:65:import_set_state_nolock()) ffff962a87fde800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789118095.469896:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 744 00000100:00080000:3.0:1789118095.469910:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789118095.469915:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff962a87fde800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118095.469957:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf7243c0 x1876025593304960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:2.0:1789118095.470164:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789118095.470170:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118095.470173:0:24116:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789118095.470177:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789118095.470179:0:24116:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789118095.470181:0:24116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789118095.470182:0:24116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789118095.470184:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789118095.470186:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118095.470187:0:24116:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789118095.470189:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789118095.470194:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118095.470195:0:24116:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789118095.470201:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789118095.470264:0:24116:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789118095.470287:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789118095.470290:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118095.470292:0:24116:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789118095.470294:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789118095.470307:0:24116:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1789118095.470310:0:24116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789118095.470312:0:24116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789118095.470313:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789118095.470322:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118095.470324:0:24116:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789118095.470327:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789118095.470331:0:24116:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789118095.470334:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789118095.470336:0:24116:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789118095.470338:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789118095.470342:0:24116:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:2.0:1789118095.470363:0:24116:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789118095.470366:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789118095.470383:0:24116:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff962bbcddb490) 00000020:00000080:2.0:1789118095.470398:0:24116:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789118095.470402:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789118095.470465:0:24116:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789118095.470472:0:24116:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789118095.470477:0:24116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be2157a 00010000:00080000:2.0:1789118095.473533:0:24116:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962a88711800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1789118095.473788:0:24116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1789118095.477996:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593304960:0@lo:38:kworker.0 00000100:00100000:0.0:1789118095.478118:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789118095.479591:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118095.479601:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789118095.479604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118095.479607:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789118095.479714:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593305088:0@lo:400:kworker.0 00000100:00100000:3.0:1789118095.479775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118095.479828:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593305088 00000100:00100000:3.0:1789118095.479835:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593305088 00000100:00100000:3.0:1789118095.479885:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789118095.479893:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593305088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118095.479946:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593305088:12345-0@lo:400:kworker.0 Request processed in 54us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118095.479954:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789118095.479999:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff962bbf727840 x1876025593305088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118095.480024:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593305088:0@lo:400:kworker.0 00000100:00100000:2.0:1789118095.485448:0:23383:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789118095.485470:0:23383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00080000:3.0:1789118095.488311:0:23382:0:(import.c:65:import_set_state_nolock()) ffff962bc0cd4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789118095.488420:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876025593304832:12345-0@lo:38:llog_process_th.0 Request processed in 18776us (20451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118095.488433:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789118095.488485:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593304960 00000100:00100000:3.0:1789118095.488507:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593304960 00000100:00100000:3.0:1789118095.488528:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789118095.488537:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593304960:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789118095.488583:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876025593304960:12345-0@lo:38:kworker.0 Request processed in 47us (10466us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789118095.488589:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:01000000:2.0:1789118095.489410:0:24116:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789118095.490582:0:24116:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1789118095.493589:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789118095.493605:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a87fde800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789118095.493612:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789118095.493617:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593304960:0@lo:38:kworker.0 00000100:00100000:0.0:1789118095.493635:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789118095.493644:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789118095.493654:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789118095.493661:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789118095.493664:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a88716000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789118095.493682:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593304832:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789118095.494261:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593305216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789118095.494548:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118095.494633:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593305216 00000100:00100000:3.0:1789118095.494641:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593305216 00000100:00100000:3.0:1789118095.494698:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789118095.494708:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1876025593305216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789118095.494749:0:23382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789118095.494815:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1876025593305216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118095.494822:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789118095.494869:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593305216:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789118095.495983:0:24116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789118095.496623:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1789118095.496777:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789118095.500808:0:24122:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789118095.500820:0:24122:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789118095.501723:0:24116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789118095.501737:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789118095.501806:0:24116:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789118095.501834:0:24116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be21581 00000100:00080000:0.0:1789118095.501846:0:24116:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789118095.501853:0:24116:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff962a88711800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789118095.501893:0:24116:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87d9f480 x1876025593305344/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789118095.502716:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593305344:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789118095.502779:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593305344 offset 0 length 520: 4 00000100:00080000:0.0:1789118095.502895:0:24116:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789118095.502971:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118095.502975:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.502977:0:24116:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789118095.502980:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789118095.502982:0:24116:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1789118095.502984:0:24116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789118095.502986:0:24116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789118095.502987:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789118095.502990:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.502991:0:24116:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789118095.502994:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00080000:3.0:1789118095.503096:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118095.503101:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789118095.503105:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118095.503108:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:0.0:1789118095.503187:0:24116:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789118095.503192:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.503194:0:24116:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789118095.503199:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789118095.503203:0:24116:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.130@tcp to nid 0x20000c0a8cc82 (192.168.204.130@tcp) 00000020:01000000:0.0:1789118095.503228:0:24116:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789118095.503230:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789118095.503246:0:24116:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff962bbd2b0000) 00000020:00000080:0.0:1789118095.503266:0:24116:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1789118095.503270:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789118095.503580:0:24116:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789118095.503587:0:24116:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789118095.503594:0:24116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xaa253ed19be2158f 00010000:00080000:0.0:1789118095.503627:0:24116:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962a86836000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1789118095.504213:0:24116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789118095.504290:0:24116:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789118095.504413:0:24116:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789118095.506830:0:24116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789118095.507249:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1789118095.507695:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1789118095.508331:0:24124:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789118095.508336:0:24124:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789118095.509335:0:24116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789118095.509348:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789118095.509394:0:24116:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789118095.509425:0:24116:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be21596 00000100:00080000:1.0:1789118095.509712:0:24116:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789118095.509719:0:24116:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962a86836000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789118095.509764:0:24116:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b8ed78b40 x1876025593305472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789118095.509837:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593305472:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789118095.509912:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593305472 offset 0 length 520: 4 00000100:00080000:1.0:1789118095.509981:0:24116:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789118095.510109:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789118095.510115:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118095.510117:0:24116:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789118095.510120:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789118095.510124:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118095.510126:0:24116:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789118095.510278:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789118095.510281:0:24116:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789118095.510284:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789118095.510287:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118095.510289:0:24116:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789118095.510291:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789118095.510293:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118095.510295:0:24116:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789118095.510298:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789118095.510333:0:24116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789118095.510336:0:24116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118095.510337:0:24116:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789118095.510340:0:24116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:3.0:1789118095.510540:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118095.510551:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789118095.510553:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118095.510556:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1789118095.510749:0:24112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1789118095.510787:0:24112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789118095.510811:0:24112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee65400/0xaa253ed19be21518 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be2151f expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118095.510821:0:24112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b8ee65400/0xaa253ed19be21518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be2151f expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789118095.510829:0:24112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962bbf6a7800 from 1 10000000:01000000:2.0:1789118095.510838:0:24112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789118095.510871:0:24112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118095.510879:0:24112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118095.510889:0:24112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118095.510908:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593305600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789118095.510964:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118095.510995:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629480 going to sleep for 11 seconds 00000100:00100000:1.0:1789118095.511111:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593305600 00000100:00100000:1.0:1789118095.511120:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593305600 00000100:00100000:1.0:1789118095.511179:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789118095.511190:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+15:24112:x1876025593305600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789118095.511204:0:23370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118095.511218:0:23370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70c400/0xaa253ed19be215a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be2159d expref: -99 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.511242:0:23370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70c400/0xaa253ed19be215a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be2159d expref: 16 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.511252:0:23370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70c400/0xaa253ed19be215a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2159d expref: 16 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.511261:0:23370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70c400, rc 0) 00000100:00100000:1.0:1789118095.511299:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+16:24112:x1876025593305600:12345-0@lo:101:mount.lustre.0 Request processed in 112us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118095.511306:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789118095.511517:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593305600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789118095.511532:0:24112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215a4 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118095.511540:0:24112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be215a4 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118095.512371:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593305728:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789118095.512447:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118095.512586:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629480 going to sleep for 11 seconds 00000100:00100000:1.0:1789118095.512712:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593305728 00000100:00100000:1.0:1789118095.512721:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593305728 00000100:00100000:1.0:1789118095.512778:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789118095.512788:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+16:24112:x1876025593305728:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789118095.512808:0:23372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789118095.512827:0:23372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789118095.512831:0:23372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789118095.512948:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+16:24112:x1876025593305728:12345-0@lo:256:mount.lustre.0 Request processed in 162us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118095.512958:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789118095.513037:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593305728:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789118095.513924:0:24112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789118095.513949:0:24112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215a4 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.513961:0:24112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215a4 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118095.513972:0:24112:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbf6a7800 from 1 10000000:01000000:1.0:1789118095.513975:0:24112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789118095.514042:0:24112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.514096:0:24112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.514112:0:24112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118095.514905:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593305856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789118095.515100:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118095.515650:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593305856 00000100:00100000:2.0:1789118095.515658:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593305856 00000100:00100000:2.0:1789118095.515721:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789118095.515733:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+16:24112:x1876025593305856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789118095.515753:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118095.515789:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92800/0xaa253ed19be215b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be215ab expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118095.515834:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92800/0xaa253ed19be215b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be215ab expref: 17 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118095.515848:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92800/0xaa253ed19be215b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be215ab expref: 17 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118095.515859:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92800, rc 0) 00000100:00100000:2.0:1789118095.515918:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:24112:x1876025593305856:12345-0@lo:101:mount.lustre.0 Request processed in 186us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118095.515925:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789118095.516004:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40840 going to sleep for 11 seconds 00000100:00100000:1.0:1789118095.516041:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593305856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789118095.516095:0:24112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215b2 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.516107:0:24112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be215b2 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789118095.517606:0:24112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 19 count 19 00000040:00080000:1.0:1789118095.517979:0:24112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789118095.518257:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789118095.518285:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1789118095.518299:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1789118095.518312:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1789118095.518327:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1789118095.518339:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1789118095.518352:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1789118095.518363:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 144 off9680 00000040:00080000:1.0:1789118095.518375:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9904 00000040:00080000:1.0:1789118095.518386:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10128 00000040:00080000:1.0:1789118095.518398:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 144 off10272 00000040:00080000:1.0:1789118095.518409:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10496 00000040:00080000:1.0:1789118095.518420:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 224 off10720 00000040:00080000:1.0:1789118095.518431:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10848 00000040:00080000:1.0:1789118095.518443:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 224 off11072 00000040:00080000:1.0:1789118095.518455:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 224 off11296 00000040:00080000:1.0:1789118095.518481:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 128 off11424 00000040:00080000:1.0:1789118095.518939:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11648 00000040:00080000:1.0:1789118095.518949:0:24112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 18 count 19 00000100:00100000:1.0:1789118095.519299:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593305984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789118095.519383:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118095.519476:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789118095.519626:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593305984 00000100:00100000:2.0:1789118095.519635:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593305984 00000100:00100000:2.0:1789118095.519725:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789118095.519735:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:24112:x1876025593305984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789118095.519898:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:24112:x1876025593305984:12345-0@lo:501:mount.lustre.0 Request processed in 164us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118095.519906:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789118095.520081:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593305984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789118095.520156:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593306112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789118095.520199:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118095.520381:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b831dfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789118095.520453:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593306112 00000100:00100000:1.0:1789118095.520457:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593306112 00000100:00100000:1.0:1789118095.520632:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789118095.520643:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:24112:x1876025593306112:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789118095.520751:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:24112:x1876025593306112:12345-0@lo:503:mount.lustre.0 Request processed in 111us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118095.520759:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789118095.520847:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593306112:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789118095.521444:0:24112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789118095.521689:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593306240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789118095.521747:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118095.521773:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b831dfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789118095.521876:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593306240 00000100:00100000:1.0:1789118095.521883:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593306240 00000100:00100000:1.0:1789118095.521920:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789118095.521929:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:24112:x1876025593306240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118095.522044:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:24112:x1876025593306240:12345-0@lo:502:mount.lustre.0 Request processed in 116us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118095.522073:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789118095.522188:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593306240:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789118095.522398:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789118095.522422:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1789118095.522433:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1789118095.522444:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1789118095.522457:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1789118095.522470:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1789118095.522484:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1789118095.522658:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 144 off9680 00000040:00080000:3.0:1789118095.522674:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9904 00000040:00080000:3.0:1789118095.522686:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10128 00000040:00080000:3.0:1789118095.522700:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 144 off10272 00000040:00080000:3.0:1789118095.522713:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10496 00000040:00080000:3.0:1789118095.522727:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 224 off10720 00000040:00080000:3.0:1789118095.522755:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10848 00000040:00080000:3.0:1789118095.522769:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 224 off11072 00000040:00080000:3.0:1789118095.522784:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 224 off11296 00000040:00080000:3.0:1789118095.522796:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 128 off11424 00000100:00100000:3.0:1789118095.522833:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593306368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789118095.522887:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118095.522921:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b831dfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789118095.523003:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593306368 00000100:00100000:1.0:1789118095.523019:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593306368 00000100:00100000:1.0:1789118095.523094:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789118095.523104:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:24112:x1876025593306368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118095.523212:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:24112:x1876025593306368:12345-0@lo:502:mount.lustre.0 Request processed in 109us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118095.523220:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789118095.523741:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593306368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789118095.523807:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11648 00000040:00080000:3.0:1789118095.523817:0:24112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:0.0:1789118095.524903:0:24126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789118095.524915:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.524917:0:24126:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789118095.524925:0:24126:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962bbf6a7800 00000020:00000080:0.0:1789118095.524927:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789118095.524935:0:24126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118095.524937:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.524938:0:24126:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789118095.524940:0:24126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789118095.524943:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.524944:0:24126:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789118095.524947:0:24126:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962bbf6a7800 00000020:00000080:0.0:1789118095.524948:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789118095.525102:0:24126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118095.525106:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.525108:0:24126:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789118095.525110:0:24126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789118095.525114:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.525115:0:24126:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789118095.525119:0:24126:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbf6a7800 00000020:00000080:0.0:1789118095.525121:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789118095.527154:0:24126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118095.527167:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.527169:0:24126:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789118095.527173:0:24126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789118095.527177:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.527178:0:24126:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789118095.527190:0:24126:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbf6a7800 00000020:00000080:0.0:1789118095.527192:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789118095.527226:0:24126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118095.527229:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.527230:0:24126:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789118095.527233:0:24126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789118095.527235:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.527237:0:24126:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789118095.527241:0:24126:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbf6a7800 00000020:00000080:0.0:1789118095.527243:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789118095.527257:0:24126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118095.527261:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.527262:0:24126:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789118095.527264:0:24126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789118095.527266:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.527267:0:24126:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789118095.527270:0:24126:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962bbf6a7800 00000020:00000080:0.0:1789118095.527272:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789118095.527304:0:24126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118095.527308:0:24126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118095.527309:0:24126:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789118095.527313:0:24126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 19 count 19 00000020:01000000:3.0:1789118095.527736:0:24112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:3.0:1789118095.527776:0:24112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789118095.527969:0:24112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215b2 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.527985:0:24112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215b2 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118095.528083:0:24112:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789118095.528087:0:24112:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962bbf6a7800 10000000:01000000:3.0:1789118095.528090:0:24112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962bbf6a7800 10000000:01000000:3.0:1789118095.528094:0:24112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789118095.528101:0:24112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962bbf6a7800 from 1 10000000:01000000:3.0:1789118095.528103:0:24112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789118095.528143:0:24112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9bc00/0xaa253ed19be215b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.528150:0:24112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a88d9bc00/0xaa253ed19be215b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.528173:0:24112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a88d9bc00/0xaa253ed19be215b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118095.528197:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593306496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789118095.528263:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118095.528300:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b831df9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789118095.530820:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593306496 00000100:00100000:0.0:1789118095.530833:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593306496 00000100:00100000:0.0:1789118095.530886:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789118095.530896:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:24112:x1876025593306496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789118095.530916:0:23370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789118095.530939:0:23370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b8ee65a00/0xaa253ed19be215c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be215b9 expref: -99 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118095.530968:0:23370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b8ee65a00/0xaa253ed19be215c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be215b9 expref: 18 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118095.530987:0:23370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b8ee65a00/0xaa253ed19be215c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be215b9 expref: 18 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118095.530998:0:23370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b8ee65a00, rc 0) 00000100:00100000:0.0:1789118095.541465:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24112:x1876025593306496:12345-0@lo:101:mount.lustre.0 Request processed in 10560us (13190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118095.541480:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789118095.542217:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593306496:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789118095.542246:0:24112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a88d9bc00/0xaa253ed19be215b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215c0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118095.542258:0:24112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a88d9bc00/0xaa253ed19be215b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be215c0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789118095.550823:0:24112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1789118095.551186:0:24112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789118095.551423:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1789118095.551450:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1789118095.551464:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1789118095.551478:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1789118095.551716:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1789118095.551735:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1789118095.551748:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1789118095.551760:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1789118095.551772:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1789118095.551783:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1789118095.551795:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1789118095.551807:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1789118095.551820:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1789118095.551834:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1789118095.551862:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1789118095.551878:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1789118095.551893:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1789118095.551908:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1789118095.551920:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1789118095.551933:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1789118095.551945:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1789118095.551955:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1789118095.551977:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1789118095.551991:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1789118095.552004:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1789118095.552032:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1789118095.552046:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1789118095.553688:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1789118095.553725:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1789118095.553743:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1789118095.553779:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1789118095.553797:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1789118095.553812:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1789118095.553827:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1789118095.553841:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1789118095.553853:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1789118095.553866:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1789118095.553880:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1789118095.553894:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1789118095.553907:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1789118095.553919:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1789118095.553930:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1789118095.553941:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1789118095.553953:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1789118095.553967:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1789118095.553980:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1789118095.554018:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1789118095.554039:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1789118095.554267:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1789118095.554288:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1789118095.554306:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1789118095.554312:0:24112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1789118095.554444:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593306624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789118095.558183:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118095.558348:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b961c2300 going to sleep for 11 seconds 00000100:00100000:0.0:1789118095.564484:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593306624 00000100:00100000:0.0:1789118095.565897:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593306624 00000100:00100000:0.0:1789118095.565976:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789118095.565988:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24112:x1876025593306624:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789118095.566252:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24112:x1876025593306624:12345-0@lo:501:mount.lustre.0 Request processed in 265us (8076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118095.566260:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789118095.566344:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593306624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789118095.566397:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593306752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789118095.566446:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118095.566479:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b90609d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789118095.567484:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593306752 00000100:00100000:0.0:1789118095.567651:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593306752 00000100:00100000:0.0:1789118095.567708:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789118095.567717:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24112:x1876025593306752:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789118095.567860:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24112:x1876025593306752:12345-0@lo:503:mount.lustre.0 Request processed in 143us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118095.567868:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789118095.567933:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593306752:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789118095.568425:0:24112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789118095.570702:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593306880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789118095.570805:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118095.570867:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b9838f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789118095.570911:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593306880 00000100:00100000:0.0:1789118095.570921:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593306880 00000100:00100000:0.0:1789118095.570982:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789118095.570991:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24112:x1876025593306880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789118095.571172:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24112:x1876025593306880:12345-0@lo:502:mount.lustre.0 Request processed in 181us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118095.571180:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789118095.571248:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593306880:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789118095.573112:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1789118095.573170:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1789118095.573185:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1789118095.573198:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1789118095.573211:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1789118095.573222:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1789118095.573234:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1789118095.573248:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1789118095.575172:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1789118095.575190:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1789118095.575204:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1789118095.575217:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1789118095.575231:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1789118095.575244:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1789118095.575257:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1789118095.575287:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1789118095.575303:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1789118095.575316:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1789118095.575350:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1789118095.575364:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1789118095.575377:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1789118095.575390:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1789118095.575404:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1789118095.575420:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1789118095.575433:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1789118095.575446:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1789118095.575459:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1789118095.575473:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1789118095.575669:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1789118095.575690:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1789118095.575703:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1789118095.575716:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1789118095.575730:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1789118095.575745:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1789118095.575773:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1789118095.575790:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1789118095.575803:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1789118095.575815:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1789118095.575829:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1789118095.575843:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1789118095.575855:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1789118095.575868:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1789118095.575881:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1789118095.575893:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1789118095.575905:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1789118095.575917:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1789118095.575930:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1789118095.575945:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1789118095.576281:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593307008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789118095.576982:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118095.577046:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b90609d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789118095.577193:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593307008 00000100:00100000:0.0:1789118095.577201:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593307008 00000100:00100000:0.0:1789118095.577267:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789118095.577276:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24112:x1876025593307008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789118095.577409:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24112:x1876025593307008:12345-0@lo:502:mount.lustre.0 Request processed in 133us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118095.577417:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789118095.577610:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593307008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789118095.577810:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1789118095.577968:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1789118095.578002:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593307136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789118095.578091:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118095.578108:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b90609d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789118095.578129:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593307136 00000100:00100000:0.0:1789118095.578133:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593307136 00000100:00100000:0.0:1789118095.578159:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789118095.578166:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24112:x1876025593307136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789118095.578234:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24112:x1876025593307136:12345-0@lo:502:mount.lustre.0 Request processed in 68us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118095.578241:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789118095.578284:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593307136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789118095.578319:0:24112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1789118095.578327:0:24112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789118095.587373:0:24131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789118095.587397:0:24131:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff962bbd2b1a48) 00000020:00000080:0.0:1789118095.587425:0:24131:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789118095.587969:0:24131:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962bbf6a7800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789118095.587975:0:24131:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962bbf6a7800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789118095.587977:0:24131:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962bbf6a7800 3 00010000:00080000:0.0:1789118095.588024:0:24131:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bc0e59800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1789118095.596164:0:24131:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789118095.596478:0:24131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789118095.596560:0:24131:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789118095.596575:0:24131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xaa253ed19be215ce 00000100:00080000:0.0:1789118095.596589:0:24131:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789118095.596597:0:24131:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff962bc0e59800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789118095.596644:0:24131:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87d9fc00 x1876025593307264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789118095.596701:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876025593307264:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789118095.596817:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789118095.596915:0:24131:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789118095.597227:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593307264 00000100:00100000:3.0:1789118095.597235:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593307264 00000100:00100000:3.0:1789118095.597273:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789118095.597282:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876025593307264:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789118095.597314:0:23378:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 747 last 0 00000020:00000080:3.0:1789118095.597347:0:23378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xaa253ed19be215d5 00000004:00100000:3.0:1789118095.597364:0:23378:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789118095.597395:0:23378:0:(import.c:65:import_set_state_nolock()) ffff962bc0cd1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789118095.597454:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876025593307264:12345-0@lo:38:llog_process_th.0 Request processed in 172us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118095.597461:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789118095.597485:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118095.597489:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789118095.597492:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118095.597495:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1789118095.597533:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff962a87d9fc00 x1876025593307264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789118105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118095.597543:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789118095.597551:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789118095.597558:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789118095.597561:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789118095.597564:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bc0e59800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789118095.597569:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876025593307264:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789118095.599310:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1789118095.599965:0:24112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789118095.600020:0:24112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789118095.600046:0:24112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9bc00/0xaa253ed19be215b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215c0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118095.600086:0:24112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a88d9bc00/0xaa253ed19be215b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215c0 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789118095.600144:0:24112:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789118095.600147:0:24112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789118095.600148:0:24112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789118095.600149:0:24112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789118095.600150:0:24112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789118095.600152:0:24112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789118095.600153:0:24112:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789118095.600155:0:24112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789118095.600156:0:24112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789118095.600160:0:24112:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789118095.600162:0:24112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789118095.600164:0:24112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789118095.600165:0:24112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789118095.600166:0:24112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789118095.600167:0:24112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789118095.600168:0:24112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789118095.600169:0:24112:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789118095.600170:0:24112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789118095.600171:0:24112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789118095.600196:0:24112:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789118095.600217:0:24112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593307392:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789118095.600300:0:24112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118095.600348:0:24112:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84c5dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789118095.600698:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593307392 00000100:00100000:0.0:1789118095.600705:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593307392 00000100:00100000:0.0:1789118095.608002:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789118095.608033:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24112:x1876025593307392:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789118095.608077:0:23369:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789118095.608092:0:23369:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789118095.620745:0:23357:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789118095.624224:0:23369:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789118095.624242:0:23369:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789118095.628286:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24112:x1876025593307392:12345-0@lo:253:mount.lustre.0 Request processed in 20245us (27969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118095.628311:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 20000000:01000000:3.0:1789118095.628514:0:23393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789118095.628531:0:23393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789118095.628554:0:23393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.628574:0:23393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b8ee64000/0xaa253ed19be214e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be214d9 expref: 17 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.628583:0:23393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bbf70c400/0xaa253ed19be215a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2159d expref: 17 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.628590:0:23393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.628645:0:23393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bbf70c400/0xaa253ed19be215a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be2159d expref: 17 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.628668:0:23393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962bbf70c400/0xaa253ed19be215a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be2159d expref: 17 pid: 23370 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118095.628687:0:23393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23393:1876025593307520:0@lo:104: 00000100:00100000:3.0:1789118095.628737:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789118095.628793:0:23393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b8ee64000/0xaa253ed19be214e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be214d9 expref: 17 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.628801:0:23393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b8ee64000/0xaa253ed19be214e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be214d9 expref: 17 pid: 23370 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118095.628809:0:23393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23393:1876025593307648:0@lo:104: 00000100:00100000:3.0:1789118095.629035:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118095.629075:0:23393:0:(client.c:2715:ptlrpc_set_wait()) set ffff962ba197fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789118095.629100:0:23360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593307520 00000100:00100000:3.0:1789118095.629116:0:23360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593307520 00000100:00100000:3.0:1789118095.629148:0:23360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593307648 00000100:00100000:3.0:1789118095.629151:0:23360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593307648 00000100:00100000:3.0:1789118095.629166:0:23360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789118095.629175:0:23360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf725a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+4:23393:x1876025593307520:12345-0@lo:104: 00010000:00010000:3.0:1789118095.629189:0:23360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be215a4 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.629236:0:23360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789118095.629243:0:23360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf725a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+4:23393:x1876025593307520:12345-0@lo:104: Request processed in 68us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118095.629249:0:23360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789118095.629265:0:23360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789118095.629272:0:23360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+3:23393:x1876025593307648:12345-0@lo:104: 00010000:00010000:3.0:1789118095.629279:0:23360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be214e0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.629310:0:23360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789118095.629316:0:23360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+3:23393:x1876025593307648:12345-0@lo:104: Request processed in 45us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118095.629321:0:23360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789118095.629348:0:23393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23393:1876025593307520:0@lo:104: 00000100:00100000:3.0:1789118095.629356:0:23393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23393:1876025593307648:0@lo:104: 00010000:00010000:3.0:1789118095.629380:0:23393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.629400:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789118095.629408:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be215a4 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.629422:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789118095.629426:0:23365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be215a4 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.629435:0:23365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be215a4 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789118095.629441:0:23365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be215a4 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118095.629447:0:23365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789118095.629478:0:23365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be215a4 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.629595:0:23365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789118095.629614:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be215a4 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.629621:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a87d93800/0xaa253ed19be2159d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be215a4 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.629633:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789118095.629636:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be214e0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.629641:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9a200 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789118095.629644:0:23365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be214e0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.629661:0:23365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be214e0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789118095.629666:0:23365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be214e0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118095.629672:0:23365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789118095.629686:0:23365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be214e0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.629692:0:23365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789118095.629707:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be214e0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.629713:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be214d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be214e0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.629728:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118095.629729:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118095.629731:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118095.629737:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118095.629755:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593307776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789118095.629785:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118095.630344:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593307904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789118095.630374:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118095.630423:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593307776 00000100:00100000:3.0:1789118095.630430:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593307776 00010000:00010000:3.0:1789118095.630458:0:23362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bbf70c400/0xaa253ed19be215a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be2159d expref: 18 pid: 23370 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118095.630682:0:24112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24112:1876025593307392:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789118095.630700:0:24112:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789118095.630704:0:24112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789118095.630706:0:24112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789118095.630707:0:24112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789118095.630709:0:24112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789118095.630710:0:24112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789118095.630712:0:24112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789118095.630725:0:24112:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789118095.630728:0:24112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789118095.630730:0:24112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789118095.630751:0:24112:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789118095.631661:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593307904 00000100:00100000:3.0:1789118095.631668:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593307904 00010000:00010000:3.0:1789118095.631692:0:23362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b8ee64000/0xaa253ed19be214e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be214d9 expref: 19 pid: 23370 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118095.631710:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789118095.631904:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf727840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+19:3647:x1876025593307776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789118095.631922:0:23362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789118095.631927:0:23362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bbf70c400/0xaa253ed19be215a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be2159d expref: 19 pid: 23370 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.631939:0:23362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bbf70c400/0xaa253ed19be215a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be2159d expref: 19 pid: 23370 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.631957:0:23362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70c400/0xaa253ed19be215a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be2159d expref: 19 pid: 23370 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.631972:0:23362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789118095.632048:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf727840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:3647:x1876025593307776:12345-0@lo:103:ldlm_bl.0 Request processed in 331us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118095.632073:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789118095.632092:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789118095.632098:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf724780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:3644:x1876025593307904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789118095.632106:0:23362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789118095.632110:0:23362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b8ee64000/0xaa253ed19be214e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be214d9 expref: 17 pid: 23370 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.632119:0:23362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b8ee64000/0xaa253ed19be214e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be214d9 expref: 17 pid: 23370 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.632142:0:23362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b8ee64000/0xaa253ed19be214e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be214d9 expref: 17 pid: 23370 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.632153:0:23362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.632162:0:23362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789118095.632179:0:23362:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014996713s 00010000:00010000:3.0:1789118095.632183:0:23362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.632190:0:23362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.632196:0:23362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.632202:0:23362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.632208:0:23362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9ba00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118095.632212:0:23362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.632218:0:23362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.632231:0:23362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.632248:0:23362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789118095.632277:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf724780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+16:3644:x1876025593307904:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118095.632284:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789118095.632348:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593307776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789118095.632372:0:23393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.632380:0:23393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118095.632387:0:23393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a88d9ba00/0xaa253ed19be215dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118095.632412:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593307904:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1789118095.645198:0:24112:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1789118095.645388:0:24140:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789118095.645398:0:24140:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789118095.645691:0:24141:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1789118095.646243:0:24141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1789118095.646962:0:24112:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:1.0:1789118095.648966:0:24112:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789118095.649025:0:24112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789118095.649438:0:24112:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789118095.649448:0:24112:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789118095.652013:0:24112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789118095.657331:0:24112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789118095.658198:0:24141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789118095.658273:0:24141:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1789118095.661086:0:24142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24142:1876025593308032:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789118095.661171:0:24142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118095.661208:0:24142:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fec600 going to sleep for 11 seconds 00000100:00100000:2.0:1789118095.662186:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593308032 00000100:00100000:2.0:1789118095.662196:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593308032 00000100:00100000:2.0:1789118095.662258:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789118095.662269:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24142:x1876025593308032:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789118095.662377:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24142:x1876025593308032:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 110us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118095.662385:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789118095.662464:0:24142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24142:1876025593308032:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789118095.662930:0:24142:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789118095.662988:0:24142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24142:1876025593308160:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789118095.663049:0:24142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118095.663112:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593308160 00000100:00100000:0.0:1789118095.663117:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593308160 00000100:00100000:0.0:1789118095.663151:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789118095.663159:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:24142:x1876025593308160:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789118095.663257:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:24142:x1876025593308160:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118095.663264:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789118095.663307:0:24142:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fec600 going to sleep for 11 seconds 00000100:00100000:0.0:1789118095.663324:0:24142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24142:1876025593308160:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789118095.663394:0:24142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:24142:1876025593308288:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789118095.663425:0:24142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118095.663460:0:23388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593308288 00000100:00100000:0.0:1789118095.663464:0:23388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593308288 00000040:00080000:1.0:1789118095.664917:0:24112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789118095.665022:0:24112:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789118095.665191:0:24112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789118095.665646:0:23388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789118095.665665:0:23388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24142:x1876025593308288:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789118095.665761:0:23388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24142:x1876025593308288:12345-0@lo:900:lod0001_rec0000.0 Request processed in 104us (2336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118095.665770:0:23388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789118095.665811:0:24142:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fec0c0 going to sleep for 11 seconds 00010000:00080000:0.0:1789118095.667126:0:24142:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff962a87d9da40 x1876025593308288/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789118111 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118095.667146:0:24142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:24142:1876025593308288:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789118095.667226:0:24142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24142:1876025593308416:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789118095.667289:0:24142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118095.667337:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593308416 00000100:00100000:0.0:1789118095.667345:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593308416 00000100:00100000:0.0:1789118095.667393:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789118095.667404:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:24142:x1876025593308416:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789118095.669658:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:24142:x1876025593308416:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 2246us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118095.669673:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789118095.669732:0:24142:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fec600 going to sleep for 11 seconds 00000100:00100000:0.0:1789118095.669776:0:24142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24142:1876025593308416:0@lo:1000:lod0001_rec0000.0 00080000:10000000:1.0:1789118095.670634:0:24112:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:0.0:1789118095.671299:0:24142:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789118095.680014:0:24142:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789118095.680161:0:24142:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789118095.680167:0:24142:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1789118095.687295:0:24112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1789118095.689866:0:24112:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789118095.689910:0:24112:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbc5cc56a7988 00100000:10000000:2.0:1789118095.689921:0:24112:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789118095.690571:0:24112:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789118095.690618:0:24112:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789118095.690643:0:24112:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789118095.690676:0:24112:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789118095.704335:0:24112:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789118095.706883:0:24112:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789118096.103422:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789118096.421270:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789118096.693946:0:24138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789118097.133632:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 10000000:01000000:3.0:1789118097.381278:0:23375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789118097.381289:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962bbf6a7800 from 12 10000000:01000000:3.0:1789118097.381298:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789118097.381378:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118097.381392:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118097.381405:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118097.381679:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593308544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789118097.381797:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118097.381867:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789118097.381984:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593308544 00000100:00100000:0.0:1789118097.381993:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593308544 00000100:00100000:0.0:1789118097.382094:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789118097.382102:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+16:23375:x1876025593308544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789118097.382114:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789118097.382127:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b8ee64400/0xaa253ed19be215ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be215e3 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118097.382159:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b8ee64400/0xaa253ed19be215ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be215e3 expref: 17 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118097.382170:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b8ee64400/0xaa253ed19be215ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be215e3 expref: 17 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118097.382179:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b8ee64400, rc 0) 00000100:00100000:0.0:1789118097.382224:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:23375:x1876025593308544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118097.382230:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789118097.382670:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593308544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789118097.382690:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215ea expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118097.382701:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be215ea expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118097.382774:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593308672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789118097.382809:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118097.382843:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789118097.382905:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593308672 00000100:00100000:0.0:1789118097.382911:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593308672 00000100:00100000:0.0:1789118097.382993:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789118097.383000:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:23375:x1876025593308672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789118097.383038:0:23369:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789118097.383084:0:23369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789118097.383088:0:23369:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1789118097.383195:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:23375:x1876025593308672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 195us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118097.383203:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789118097.383267:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593308672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789118097.383315:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789118097.383322:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215ea expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118097.383331:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215ea expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118097.383341:0:23375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789118097.383344:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962a8795a800 from 12 10000000:01000000:3.0:1789118097.383347:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789118097.383367:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118097.383383:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118097.383392:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118097.383406:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593308800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789118097.383723:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118097.387390:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789118097.390095:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593308800 00000100:00100000:2.0:1789118097.390114:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593308800 00000100:00100000:2.0:1789118097.390187:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789118097.390197:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:23375:x1876025593308800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789118097.390215:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118097.390236:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92e00/0xaa253ed19be215f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be215f1 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118097.390272:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92e00/0xaa253ed19be215f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be215f1 expref: 18 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118097.390307:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92e00/0xaa253ed19be215f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be215f1 expref: 18 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118097.390316:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92e00, rc 0) 00000100:00100000:2.0:1789118097.390421:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:23375:x1876025593308800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (6698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118097.390428:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789118097.390464:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593308800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789118097.390483:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215f8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118097.390493:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be215f8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118097.390557:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593308928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789118097.390603:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118097.390643:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789118097.390815:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593308928 00000100:00100000:2.0:1789118097.390820:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593308928 00000100:00100000:2.0:1789118097.390842:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789118097.390848:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:23375:x1876025593308928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789118097.390864:0:23372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789118097.390881:0:23372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789118097.390884:0:23372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789118097.390970:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:23375:x1876025593308928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118097.390989:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789118097.391329:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593308928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789118097.391377:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789118097.391387:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215f8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118097.391396:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be215f8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118097.446826:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789118097.701818:0:24138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789118098.152008:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789118098.476305:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789118099.117472:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789118099.173123:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789118099.496852:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789118100.210958:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789118100.518661:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118100.838658:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789118100.838680:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593309056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789118100.838750:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789118100.843800:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789118100.843809:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789118100.843815:0:37:0:(import.c:65:import_set_state_nolock()) ffff962a87fde800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789118100.843834:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff962a87fde800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789118100.843868:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87f68b40 x1876025593309312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789118100.843891:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789118100.843925:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789118100.843928:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789118100.843932:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789118100.843950:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789118100.843954:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789118100.843956:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789118100.843960:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789118100.844017:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593309056 00000100:00100000:2.0:1789118100.844025:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593309056 00000100:00100000:2.0:1789118100.844101:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789118100.844112:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593309056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789118100.844152:0:23382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789118100.844247:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593309056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (5497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118100.844254:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789118100.844282:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593309440:0@lo:400:kworker.0 00000100:00100000:2.0:1789118100.844329:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118100.844360:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789118100.844366:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593309184:0@lo:400:kworker.0 00000100:00100000:2.0:1789118100.844396:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118100.844432:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593309312:0@lo:38:kworker.0 00000100:00100000:2.0:1789118100.845237:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118100.845328:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593309440 00000100:00100000:2.0:1789118100.845334:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593309440 00000100:00100000:2.0:1789118100.845383:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789118100.845391:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593309440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118100.845447:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593309440:12345-0@lo:400:kworker.0 Request processed in 57us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118100.845454:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789118100.845556:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593309184 00000100:00100000:2.0:1789118100.845561:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593309184 00000100:00100000:2.0:1789118100.845587:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789118100.845593:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:3647:x1876025593309184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118100.845627:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:3647:x1876025593309184:12345-0@lo:400:kworker.0 Request processed in 34us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118100.845633:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789118100.845690:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593309184:0@lo:400:kworker.0 00010000:00080000:2.0:1789118100.845709:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a87f692c0 x1876025593309440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118100.845720:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593309440:0@lo:400:kworker.0 00000100:00100000:2.0:1789118100.845745:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789118100.845756:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593309568:0@lo:400:kworker.0 00000100:00100000:2.0:1789118100.845791:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118100.845817:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593309568 00000100:00100000:2.0:1789118100.845820:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593309568 00000100:00100000:2.0:1789118100.845844:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789118100.845850:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593309568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118100.845881:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593309568:12345-0@lo:400:kworker.0 Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118100.845897:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789118100.849088:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a87f69680 x1876025593309568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118100.849108:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593309568:0@lo:400:kworker.0 00000100:00100000:2.0:1789118100.849166:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593309056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789118100.853639:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593309312 00000100:00100000:0.0:1789118100.853660:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593309312 00000100:00100000:0.0:1789118100.854878:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789118100.854893:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876025593309312:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789118100.854972:0:23383:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 753 last 0 00000020:00000080:0.0:1789118100.855030:0:23383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be215ff 00000004:00100000:0.0:1789118100.855225:0:23383:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789118100.855234:0:23383:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1789118100.870746:0:23383:0:(import.c:65:import_set_state_nolock()) ffff962bc0cd4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789118100.870881:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876025593309312:12345-0@lo:38:kworker.0 Request processed in 15986us (25643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118100.870893:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789118100.871485:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789118100.871496:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789118100.871501:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789118100.871505:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a87fde800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789118100.871517:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000054f4b46d): req@ffff962bbf7270c0 x1876025593301888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118100.871547:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593309312:0@lo:38:kworker.0 00000100:00100000:3.0:1789118100.871702:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118100.871736:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789118100.871896:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789118100.871924:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593309696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789118100.871955:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118100.872134:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593301888 00000100:00100000:2.0:1789118100.872140:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593301888 00000100:00100000:2.0:1789118100.872183:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593309696 00000100:00100000:2.0:1789118100.872187:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593309696 00000100:00100000:2.0:1789118100.872203:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789118100.872211:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf724b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:23420:x1876025593301888:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789118100.872288:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf724b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:23420:x1876025593301888:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 78us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118100.872296:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789118100.872311:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789118100.872318:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593309696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789118100.872344:0:24121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789118100.872416:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593309696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118100.872423:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789118100.872663:0:23420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23420:1876025593301888:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789118100.872699:0:23420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789118100.872737:0:23420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed79a40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23420:1876025593309824:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789118100.872770:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118100.872804:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b837aee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789118100.872832:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593309696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789118100.873149:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593309824 00000100:00100000:2.0:1789118100.873154:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593309824 00000100:00100000:2.0:1789118100.875668:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789118100.875697:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23420:x1876025593309824:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789118100.875923:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23420:x1876025593309824:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 222us (3136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118100.875931:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789118100.878628:0:23420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed79a40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23420:1876025593309824:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789118100.878751:0:23420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed79a40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23420:1876025593309952:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789118100.878817:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118100.883716:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b837aee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789118100.890207:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593309952 00000100:00100000:3.0:1789118100.890226:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593309952 00000100:00100000:3.0:1789118100.912163:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789118100.912182:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23420:x1876025593309952:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789118100.912333:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23420:x1876025593309952:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 156us (33515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118100.912342:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789118100.912476:0:23420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed79a40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23420:1876025593309952:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789118100.912545:0:23420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789118100.914741:0:23420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789118100.914839:0:23420:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 23, retries 0 00000004:00080000:1.0:1789118100.914844:0:23420:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789118101.541529:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789118101.628883:0:24384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789118102.567114:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789118102.601353:0:24439:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789118102.601595:0:24439:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789118102.885192:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789118087/real 1789118087] req@ffff962a87d9f840 x1876025593302912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118102 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118102.885237:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962a87d9f840 x1876025593302912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118102 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118102.885247:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789118087/real 1789118087] req@ffff962a87d9cb40 x1876025593303040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118102 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118102.885257:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962a87d9cb40 x1876025593303040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118102 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789118102.885280:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbce12800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789118102.885313:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789118102.885318:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593302912:0@lo:8:kworker.0 00000100:00080000:2.0:1789118102.885325:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b90578800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789118102.885331:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789118102.885353:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593303040:0@lo:8:kworker.0 00000100:00080000:3.0:1789118102.885888:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118102.885893:0:24392:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789118102.885896:0:24392:0:(import.c:65:import_set_state_nolock()) ffff962bbce12800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789118102.885903:0:24392:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 739 00000100:00080000:3.0:1789118102.885909:0:24392:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1789118102.885910:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593310208:0@lo:400:kworker.0 00000100:00080000:3.0:1789118102.885915:0:24392:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff962bbce12800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118102.885940:0:24392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf726940 x1876025593310336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789118102.885969:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118102.885981:0:24392:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789118102.885983:0:24392:0:(import.c:65:import_set_state_nolock()) ffff962b90578800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789118102.885986:0:24392:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 739 00000100:00080000:3.0:1789118102.885989:0:24392:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1789118102.885990:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789118102.885992:0:24392:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b90578800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118102.886005:0:24392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf7270c0 x1876025593310464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789118102.886037:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1789118102.886040:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1789118102.886041:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789118102.886044:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1789118102.886046:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593310080:0@lo:400:kworker.0 00000100:00080000:3.0:1789118102.886047:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789118102.886095:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b9277e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593310720:0@lo:400:kworker.0 00000100:00100000:2.0:1789118102.886096:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118102.886115:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789118102.886121:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b9277fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593310848:0@lo:400:kworker.0 00000100:00100000:3.0:1789118102.886122:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118102.886140:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789118102.886144:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf725e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593310592:0@lo:400:kworker.0 00000100:00100000:2.0:1789118102.886145:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118102.886164:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118102.886261:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593310208 00000100:00100000:3.0:1789118102.886269:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593310208 00000100:00100000:3.0:1789118102.886318:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593310720 00000100:00100000:3.0:1789118102.886321:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593310720 00000100:00100000:3.0:1789118102.886336:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789118102.886345:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593310208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118102.886444:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789118102.886455:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593310720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118102.886519:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593310720:12345-0@lo:400:kworker.0 Request processed in 67us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118102.886526:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789118102.886565:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b9277e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593310720:0@lo:400:kworker.0 00000100:00100000:3.0:1789118102.886665:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876025593310208:12345-0@lo:400:kworker.0 Request processed in 320us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118102.886672:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789118102.886741:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593310208:0@lo:400:kworker.0 00000100:00100000:1.0:1789118102.886846:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593310080 00000100:00100000:1.0:1789118102.886850:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593310080 00000100:00100000:1.0:1789118102.886901:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789118102.886910:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:3647:x1876025593310080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118102.886946:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:3647:x1876025593310080:12345-0@lo:400:kworker.0 Request processed in 39us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118102.886952:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789118102.886991:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593310336:0@lo:8:kworker.0 00000400:00000100:1.0:1789118102.887013:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593310336 offset 0 length 520: 4 00000100:00100000:1.0:1789118102.887034:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593310464:0@lo:8:kworker.0 00000400:00000100:1.0:1789118102.887075:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593310464 offset 0 length 520: 4 00000100:00100000:0.0:1789118102.887151:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593310080:0@lo:400:kworker.0 00000100:00100000:2.0:1789118102.889070:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593310848 00000100:00100000:2.0:1789118102.889091:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593310848 00000100:00100000:2.0:1789118102.889204:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593310592 00000100:00100000:2.0:1789118102.889207:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593310592 00000100:00100000:3.0:1789118102.891951:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789118102.891979:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593310848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118102.892288:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593310848:12345-0@lo:400:kworker.0 Request processed in 322us (6139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118102.892297:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789118102.892329:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789118102.892337:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593310592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118102.893590:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593310592:12345-0@lo:400:kworker.0 Request processed in 1242us (7412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118102.893606:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789118102.898855:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962b9277fc00 x1876025593310848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118102.898891:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b9277fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593310848:0@lo:400:kworker.0 00010000:00080000:1.0:1789118102.898959:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bbf725e00 x1876025593310592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118102.898969:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf725e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593310592:0@lo:400:kworker.0 00010000:00010000:3.0:1789118103.599258:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789118103.780651:0:24489:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789118103.781333:0:24489:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789118104.613725:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789118105.046937:0:24538:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7643b700 20000000:00000080:3.0:1789118105.046957:0:24538:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962b90832400 uarg=0000000000000000 20000000:01000000:3.0:1789118105.047015:0:24538:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789118105.047024:0:24538:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789118105.047031:0:24538:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789118105.047686:0:24539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 19 20000000:00000400:3.0:1789118105.049957:0:24538:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789118105.065558:0:24538:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789118105.068873:0:24538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118105.068898:0:24538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a88d9a600/0xaa253ed19be214af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be214a8 expref: 17 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118105.068905:0:24538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d92800/0xaa253ed19be215b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be215ab expref: 17 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118105.068912:0:24538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118105.068961:0:24538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d92800/0xaa253ed19be215b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be215ab expref: 17 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118105.068977:0:24538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962a87d92800/0xaa253ed19be215b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be215ab expref: 17 pid: 23369 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118105.069011:0:24538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24538:1876025593310976:0@lo:104: 00000100:00100000:2.0:1789118105.069186:0:24538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789118105.069299:0:24538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a88d9a600/0xaa253ed19be214af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be214a8 expref: 17 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118105.069317:0:24538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962a88d9a600/0xaa253ed19be214af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be214a8 expref: 17 pid: 23370 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118105.069326:0:24538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24538:1876025593311104:0@lo:104: 00000100:00100000:2.0:1789118105.069349:0:24538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118105.071118:0:24538:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87deb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789118105.071671:0:23361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593310976 00000100:00100000:3.0:1789118105.071685:0:23361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593310976 00000100:00100000:2.0:1789118105.071879:0:23361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593311104 00000100:00100000:2.0:1789118105.071884:0:23361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593311104 00000100:00100000:2.0:1789118105.071905:0:23361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789118105.071915:0:23361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+4:24538:x1876025593310976:12345-0@lo:104: 00010000:00010000:2.0:1789118105.071937:0:23361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be215b2 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118105.072160:0:24538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24538:1876025593310976:0@lo:104: 00010000:00010000:2.0:1789118105.072237:0:23361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789118105.072245:0:23361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+4:24538:x1876025593310976:12345-0@lo:104: Request processed in 331us (3059us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118105.072254:0:23361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789118105.072277:0:23361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789118105.072283:0:23361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+3:24538:x1876025593311104:12345-0@lo:104: 00010000:00010000:2.0:1789118105.072292:0:23361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be214af expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118105.072543:0:24538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24538:1876025593311104:0@lo:104: 00010000:00010000:3.0:1789118105.072567:0:24538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118105.072982:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789118105.072991:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be215b2 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118105.073000:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70dc00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789118105.073011:0:23366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be215b2 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118105.073020:0:23366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be215b2 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789118105.073027:0:23366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be215b2 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118105.073034:0:23366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789118105.073116:0:23366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be215b2 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118105.073123:0:23366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789118105.073155:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be215b2 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118105.073163:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbf70dc00/0xaa253ed19be215ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be215b2 expref: -99 pid: 24112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118105.073180:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789118105.073184:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be214af expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118105.073190:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b8ee64e00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789118105.073192:0:23366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be214af expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118105.073199:0:23366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be214af expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789118105.073215:0:23366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be214af expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118105.073221:0:23366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789118105.073247:0:23366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be214af expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118105.073254:0:23366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789118105.073271:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be214af expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118105.073278:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b8ee64e00/0xaa253ed19be214a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be214af expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118105.073294:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118105.073295:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118105.073297:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118105.073483:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593311232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789118105.073548:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118105.073637:0:23363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593311232 00000100:00100000:0.0:1789118105.073645:0:23363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593311232 00010000:00010000:0.0:1789118105.073677:0:23363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d92800/0xaa253ed19be215b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be215ab expref: 18 pid: 23369 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118105.073710:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789118105.073718:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:3647:x1876025593311232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789118105.073730:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789118105.073735:0:23363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d92800/0xaa253ed19be215b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be215ab expref: 18 pid: 23369 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.073760:0:23363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d92800/0xaa253ed19be215b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be215ab expref: 18 pid: 23369 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.073774:0:23363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92800/0xaa253ed19be215b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be215ab expref: 18 pid: 23369 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.073787:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789118105.073817:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:3647:x1876025593311232:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118105.073824:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789118105.073883:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593311232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789118105.074006:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593311360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789118105.074037:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118105.074238:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593311360 00000100:00100000:0.0:1789118105.074242:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593311360 00010000:00010000:0.0:1789118105.074258:0:23362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a88d9a600/0xaa253ed19be214af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be214a8 expref: 17 pid: 23370 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118105.074450:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789118105.074459:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:3644:x1876025593311360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789118105.074469:0:23362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789118105.074474:0:23362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a88d9a600/0xaa253ed19be214af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be214a8 expref: 17 pid: 23370 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.074484:0:23362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a88d9a600/0xaa253ed19be214af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be214a8 expref: 17 pid: 23370 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.074495:0:23362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a88d9a600/0xaa253ed19be214af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be214a8 expref: 17 pid: 23370 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.074506:0:23362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.074514:0:23362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.074526:0:23362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.074533:0:23362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.074539:0:23362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.074553:0:23362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.074558:0:23362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92200 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118105.074563:0:23362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.074570:0:23362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.074594:0:23362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118105.074605:0:23362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789118105.074642:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+16:3644:x1876025593311360:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118105.074648:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789118105.074705:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593311360:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789118105.074731:0:24538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118105.074752:0:24538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118105.074758:0:24538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92200/0xaa253ed19be21606 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118105.076187:0:23361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789118105.076203:0:23361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+3:24538:x1876025593311104:12345-0@lo:104: Request processed in 3915us (6848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118105.076214:0:23361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789118105.077876:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118105.637218:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118105.957185:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593311488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789118105.957322:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118105.957373:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593311616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789118105.957386:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593311488 00000100:00100000:2.0:1789118105.957393:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593311488 00000100:00100000:3.0:1789118105.957396:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118105.957433:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593311616 00000100:00100000:3.0:1789118105.957437:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593311616 00000100:00100000:2.0:1789118105.957437:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789118105.957455:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789118105.957458:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593311488:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789118105.957460:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593311616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789118105.957492:0:23382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000004:00000024:2.0:1789118105.957492:0:24121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789118105.957534:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593311616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118105.957541:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789118105.958149:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593311488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 700us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118105.958158:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789118105.958398:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789118095/real 1789118095] req@ffff962b8ed78b40 x1876025593305472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118105 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118105.958421:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962b8ed78b40 x1876025593305472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118105 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118105.958432:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789118095/real 1789118095] req@ffff962a87d9f480 x1876025593305344/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118105 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118105.958443:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962a87d9f480 x1876025593305344/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118105 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789118105.958458:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a86836000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789118105.958481:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789118105.958486:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593305472:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789118105.958491:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a88711800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789118105.958496:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789118105.958499:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593305344:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789118105.958623:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593311744:0@lo:400:kworker.0 00000100:00100000:1.0:1789118105.958677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789118105.958683:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789118105.958688:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789118105.958691:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789118105.958694:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789118105.958715:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1789118105.958716:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1789118105.958719:0:24392:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:1.0:1789118105.958721:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593311872:0@lo:400:kworker.0 00000100:00080000:2.0:1789118105.958722:0:24392:0:(import.c:65:import_set_state_nolock()) ffff962a88711800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789118105.958727:0:24392:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 747 00000100:00080000:2.0:1789118105.958731:0:24392:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789118105.958737:0:24392:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff962a88711800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789118105.958746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118105.958903:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593311744 00000100:00100000:0.0:1789118105.958910:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593311744 00000100:00100000:0.0:1789118105.958962:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789118105.958973:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8470ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+16:3646:x1876025593311744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118105.959027:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8470ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+16:3646:x1876025593311744:12345-0@lo:400:kworker.0 Request processed in 56us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118105.959035:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789118105.959108:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593311744:0@lo:400:kworker.0 00000100:00100000:2.0:1789118105.959133:0:24392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87f68f00 x1876025593312000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789118105.959154:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789118105.959157:0:24392:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789118105.959159:0:24392:0:(import.c:65:import_set_state_nolock()) ffff962a86836000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789118105.959240:0:24392:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 747 00000100:00080000:2.0:1789118105.959244:0:24392:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789118105.959320:0:24392:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962a86836000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789118105.959338:0:24392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87f6a940 x1876025593312128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789118105.959394:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593312000:0@lo:8:kworker.0 00000400:00000100:1.0:1789118105.959420:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593312000 offset 0 length 520: 4 00000100:00100000:0.0:1789118105.959428:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593312256:0@lo:400:kworker.0 00000100:00100000:1.0:1789118105.959440:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593312128:0@lo:8:kworker.0 00000100:00100000:0.0:1789118105.959455:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:1.0:1789118105.959457:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876025593312128 offset 0 length 520: 4 00000100:00100000:2.0:1789118105.959540:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593311872 00000100:00100000:2.0:1789118105.959546:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593311872 00000100:00100000:2.0:1789118105.959749:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593312256 00000100:00100000:2.0:1789118105.959754:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593312256 00000100:00100000:0.0:1789118105.959989:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789118105.960008:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593311872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118105.960090:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593311872:12345-0@lo:400:kworker.0 Request processed in 84us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118105.960097:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789118105.960111:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a87f6b840 x1876025593311872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118105.960123:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593311872:0@lo:400:kworker.0 00000100:00100000:3.0:1789118105.960224:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593311488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789118105.960244:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593311616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789118105.960329:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789118105.960340:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593312256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118105.960399:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593312256:12345-0@lo:400:kworker.0 Request processed in 62us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118105.960406:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789118105.960421:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962a87f68000 x1876025593312256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118105.960432:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593312256:0@lo:400:kworker.0 10000000:01000000:3.0:1789118106.149252:0:23375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789118106.149268:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbf6a7800 from 19 10000000:01000000:3.0:1789118106.149276:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789118106.149360:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118106.149376:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118106.149392:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118106.149431:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593312384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789118106.149537:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118106.149606:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789118106.149652:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593312384 00000100:00100000:2.0:1789118106.149662:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593312384 00000100:00100000:2.0:1789118106.149755:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789118106.149768:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b84708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+16:23375:x1876025593312384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789118106.149786:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118106.149816:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92600/0xaa253ed19be21614 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be2160d expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118106.149866:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92600/0xaa253ed19be21614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be2160d expref: 17 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118106.149879:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92600/0xaa253ed19be21614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2160d expref: 17 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118106.149890:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92600, rc 0) 00000100:00100000:2.0:1789118106.149952:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b84708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:23375:x1876025593312384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118106.149960:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789118106.150163:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593312384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789118106.150185:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21614 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118106.150207:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21614 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118106.150296:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593312512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789118106.150326:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118106.150367:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789118106.150419:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593312512 00000100:00100000:1.0:1789118106.150424:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593312512 00000100:00100000:1.0:1789118106.150461:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789118106.150469:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b84709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:23375:x1876025593312512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789118106.150613:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b84709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:23375:x1876025593312512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118106.150621:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789118106.151236:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593312512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789118106.151292:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593312640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789118106.151375:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118106.151409:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789118106.151506:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593312640 00000100:00100000:1.0:1789118106.151511:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593312640 00000100:00100000:1.0:1789118106.151556:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789118106.151566:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b84709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:23375:x1876025593312640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789118106.151687:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b84709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:23375:x1876025593312640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118106.151704:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789118106.151845:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593312640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789118106.152784:0:24569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789118106.153186:0:23375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789118106.153224:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789118106.153244:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21614 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118106.153257:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21614 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118106.153269:0:23375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789118106.153273:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962a8795a800 from 19 10000000:01000000:1.0:1789118106.153276:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789118106.153333:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118106.153342:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118106.153366:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118106.153401:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593312768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789118106.153482:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118106.153535:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf6120c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789118106.153625:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593312768 00000100:00100000:2.0:1789118106.153636:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593312768 00000100:00100000:2.0:1789118106.153701:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789118106.153716:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8470bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+17:23375:x1876025593312768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789118106.153733:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118106.153750:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d93400/0xaa253ed19be21622 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be2161b expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118106.153782:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93400/0xaa253ed19be21622 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be2161b expref: 18 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118106.153796:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d93400/0xaa253ed19be21622 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2161b expref: 18 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118106.153817:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93400, rc 0) 00000100:00100000:2.0:1789118106.153864:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8470bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:23375:x1876025593312768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118106.153900:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789118106.154540:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593312768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789118106.154560:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21622 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118106.154571:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21622 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118106.154655:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593312896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789118106.154703:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118106.154851:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629240 going to sleep for 11 seconds 00000100:00100000:0.0:1789118106.161849:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593312896 00000100:00100000:0.0:1789118106.161879:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593312896 00000100:00100000:0.0:1789118106.161965:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789118106.161978:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8470a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:23375:x1876025593312896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789118106.162255:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8470a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:23375:x1876025593312896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (7551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118106.162263:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789118106.162509:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593312896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789118106.162623:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593313024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789118106.162725:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118106.162776:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629240 going to sleep for 11 seconds 00000100:00100000:0.0:1789118106.163123:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593313024 00000100:00100000:0.0:1789118106.163133:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593313024 00000100:00100000:0.0:1789118106.163222:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789118106.163232:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:23375:x1876025593313024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789118106.163406:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:23375:x1876025593313024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118106.163416:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789118106.163575:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593313024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789118106.167038:0:24570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789118106.167225:0:23375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789118106.167710:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789118106.167731:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21622 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118106.167747:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21622 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1789118106.489014:0:24113:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789118106.663311:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118107.686190:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789118107.947364:0:24138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789118108.709585:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789118109.352758:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789118109.733310:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118110.757555:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118111.077799:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593313280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789118111.077886:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118111.077974:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593313280 00000100:00100000:2.0:1789118111.077985:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593313280 00000100:00100000:2.0:1789118111.078037:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789118111.078048:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593313280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789118111.078120:0:23382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00080000:0.0:1789118111.078378:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118111.078383:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789118111.078386:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118111.078389:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789118111.078398:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118111.078400:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789118111.078416:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118111.078419:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789118111.078493:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593313152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789118111.078530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118111.078564:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf725e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593313664:0@lo:400:kworker.0 00000100:00100000:3.0:1789118111.078587:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118111.078608:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789118111.078613:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593313536:0@lo:400:kworker.0 00000100:00100000:3.0:1789118111.078634:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118111.078696:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593313280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 648us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118111.078706:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789118111.078733:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593313152 00000100:00100000:2.0:1789118111.078737:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593313152 00000100:00100000:2.0:1789118111.078751:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593313536 00000100:00100000:2.0:1789118111.078753:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593313536 00000100:00100000:2.0:1789118111.078762:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789118111.078768:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593313152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789118111.078786:0:23382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789118111.078874:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876025593313152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118111.078880:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789118111.078892:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789118111.078898:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593313536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118111.078936:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593313536:12345-0@lo:400:kworker.0 Request processed in 39us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118111.078944:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789118111.078968:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593313664 00000100:00100000:2.0:1789118111.078971:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593313664 00000100:00100000:2.0:1789118111.079000:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789118111.079006:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593313664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118111.079036:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876025593313664:12345-0@lo:400:kworker.0 Request processed in 31us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118111.079042:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789118111.079088:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593313408:0@lo:400:kworker.0 00000100:00100000:2.0:1789118111.079121:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118111.079148:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789118111.079164:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593313792:0@lo:400:kworker.0 00000100:00100000:2.0:1789118111.079188:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118111.079343:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593313408 00000100:00100000:2.0:1789118111.079347:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593313408 00000100:00100000:2.0:1789118111.079375:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789118111.079382:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:3647:x1876025593313408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118111.079416:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:3647:x1876025593313408:12345-0@lo:400:kworker.0 Request processed in 35us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118111.079422:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789118111.079470:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593313408:0@lo:400:kworker.0 00000100:00100000:2.0:1789118111.079506:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593313280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789118111.081918:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593313792 00000100:00100000:0.0:1789118111.081936:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593313792 00000100:00100000:0.0:1789118111.082011:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789118111.082023:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593313792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118111.082166:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593313792:12345-0@lo:400:kworker.0 Request processed in 146us (2976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118111.082173:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789118111.082769:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bbf7243c0 x1876025593313792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118111.082814:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593313792:0@lo:400:kworker.0 00000100:00100000:3.0:1789118111.086359:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593313152:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1789118111.086484:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff962bbf725e00 x1876025593313664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118111.086518:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf725e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876025593313664:0@lo:400:kworker.0 00000100:00100000:2.0:1789118111.086551:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593313536:0@lo:400:kworker.0 00010000:00010000:3.0:1789118111.792044:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118112.807424:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789118113.557542:0:24886:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789118113.557548:0:24886:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789118113.557549:0:24886:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789118113.557684:0:24886:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff962b90883800 00000020:01000004:1.0:1789118113.557849:0:24886:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789118113.557869:0:24886:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789118113.557884:0:24886:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff962a87e20000) 00000020:00000080:1.0:1789118113.557903:0:24886:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789118113.604586:0:24886:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789118113.606003:0:24886:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789118113.606755:0:24886:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789118113.607021:0:24886:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789118113.607545:0:24886:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789118113.607796:0:24886:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789118113.608026:0:24886:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1789118113.612236:0:24886:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789118113.612873:0:24886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789118113.612889:0:24886:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789118113.612902:0:24886:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa253ed19be21630 00000020:01000004:3.0:1789118113.612911:0:24886:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789118113.612937:0:24886:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789118113.612940:0:24886:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789118113.612947:0:24886:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789118113.612953:0:24886:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789118113.612966:0:24886:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff962bbfac8000) 00000020:00000080:3.0:1789118113.612978:0:24886:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789118113.614477:0:24886:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789118113.614713:0:24886:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789118113.614720:0:24886:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789118113.615725:0:24886:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789118113.615734:0:24886:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789118113.616237:0:24886:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789118113.616244:0:24886:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789118113.618362:0:24886:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789118113.618586:0:24886:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789118113.619732:0:24886:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789118113.620512:0:24886:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789118113.620521:0:24886:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789118113.645187:0:24886:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789118113.645455:0:24886:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789118113.645463:0:24886:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789118113.649037:0:24886:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789118113.649223:0:24886:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789118113.651045:0:24886:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789118113.651331:0:24886:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789118113.657182:0:24886:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789118113.661218:0:24886:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789118113.661230:0:24886:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789118113.664297:0:24886:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789118113.664315:0:24886:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789118113.735559:0:24886:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789118113.735768:0:24886:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789118113.735773:0:24886:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789118113.740081:0:24886:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789118113.740096:0:24886:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789118113.741294:0:24886:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789118113.741326:0:24886:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789118113.741333:0:24886:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789118113.770178:0:24886:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789118113.770240:0:24886:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.130@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789118113.770246:0:24886:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789118113.770247:0:24886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789118113.770249:0:24886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789118113.770261:0:24886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789118113.770263:0:24886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789118113.770265:0:24886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789118113.770266:0:24886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789118113.770268:0:24886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789118113.770269:0:24886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789118113.770274:0:24886:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789118113.770276:0:24886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789118113.770277:0:24886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789118113.770278:0:24886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789118113.770279:0:24886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789118113.770280:0:24886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789118113.770281:0:24886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789118113.770282:0:24886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789118113.770284:0:24886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789118113.770285:0:24886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789118113.770321:0:24886:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789118113.770353:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593313920:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789118113.770452:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118113.770508:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789118113.770885:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593313920 00000100:00100000:0.0:1789118113.770896:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593313920 00000100:00100000:0.0:1789118113.770964:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789118113.770975:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24886:x1876025593313920:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789118113.771013:0:23370:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789118113.771016:0:23370:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789118113.771020:0:23370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789118113.771730:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24886:x1876025593313920:12345-0@lo:253:mount.lustre.0 Request processed in 754us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118113.771741:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789118113.771937:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593313920:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789118113.771950:0:24886:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789118113.771952:0:24886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789118113.771954:0:24886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789118113.771955:0:24886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789118113.771956:0:24886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789118113.771957:0:24886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789118113.771958:0:24886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789118113.771960:0:24886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789118113.771961:0:24886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789118113.771963:0:24886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789118113.771980:0:24886:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962b90883800 from lustre-OST0000 10000000:01000000:1.0:1789118113.772013:0:24886:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789118113.772017:0:24886:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789118113.772027:0:24886:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962b88029a48 local copy 00010000:00010000:1.0:1789118113.772041:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be213f2 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118113.772237:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789118113.772295:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118113.772337:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bc20f1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789118113.772540:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593314048 00000100:00100000:2.0:1789118113.772549:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593314048 00000100:00100000:2.0:1789118113.772621:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789118113.772632:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24886:x1876025593314048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789118113.772740:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24886:x1876025593314048:12345-0@lo:501:mount.lustre.0 Request processed in 109us (445us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789118113.772748:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789118113.773924:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314048:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789118113.773955:0:24886:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789118113.773987:0:24886:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789118113.773997:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be213f2 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.774007:0:24886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be213f2 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118113.774077:0:24886:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962b90883800 10000000:01000000:1.0:1789118113.774083:0:24886:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789118113.774089:0:24886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789118113.774092:0:24886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789118113.774097:0:24886:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789118113.774100:0:24886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789118113.774134:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be2163e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.774270:0:24886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be2163e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.774283:0:24886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be2163e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118113.774306:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789118113.774361:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118113.774403:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bc20f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1789118113.774545:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593314176 00000100:00100000:0.0:1789118113.774553:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593314176 00000100:00100000:0.0:1789118113.774615:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789118113.774624:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+18:24886:x1876025593314176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789118113.774638:0:23370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789118113.774653:0:23370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b8ee65600/0xaa253ed19be21645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be2163e expref: -99 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118113.774704:0:23370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b8ee65600/0xaa253ed19be21645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be2163e expref: 19 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118113.774715:0:23370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b8ee65600/0xaa253ed19be21645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2163e expref: 19 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118113.774725:0:23370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b8ee65600, rc 0) 00000100:00100000:0.0:1789118113.774769:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+19:24886:x1876025593314176:12345-0@lo:101:mount.lustre.0 Request processed in 146us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118113.774776:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789118113.775221:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789118113.775239:0:24886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be2163e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21645 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.775260:0:24886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be2163e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21645 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789118113.776955:0:24886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1789118113.784474:0:24886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789118113.786975:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789118113.787040:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1789118113.787087:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1789118113.787105:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1789118113.787116:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1789118113.787126:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1789118113.787137:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1789118113.787147:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1789118113.787157:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1789118113.787167:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1789118113.787177:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1789118113.787187:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1789118113.787208:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1789118113.787213:0:24886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1789118113.787338:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789118113.787418:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118113.787710:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c7780 going to sleep for 11 seconds 00000100:00100000:2.0:1789118113.787772:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593314304 00000100:00100000:2.0:1789118113.787780:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593314304 00000100:00100000:2.0:1789118113.787892:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789118113.787904:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+19:24886:x1876025593314304:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789118113.788117:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+19:24886:x1876025593314304:12345-0@lo:501:mount.lustre.0 Request processed in 214us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118113.788125:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789118113.788225:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789118113.788268:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789118113.788315:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118113.788476:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789118113.788560:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593314432 00000100:00100000:0.0:1789118113.788567:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593314432 00000100:00100000:0.0:1789118113.788608:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789118113.788616:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+19:24886:x1876025593314432:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789118113.789346:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+19:24886:x1876025593314432:12345-0@lo:503:mount.lustre.0 Request processed in 727us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118113.789356:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789118113.789458:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314432:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789118113.789925:0:24886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789118113.790022:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118113.790126:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118113.790341:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789118113.790424:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593314560 00000100:00100000:0.0:1789118113.790430:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593314560 00000100:00100000:0.0:1789118113.790464:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789118113.790473:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+19:24886:x1876025593314560:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789118113.791086:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+19:24886:x1876025593314560:12345-0@lo:502:mount.lustre.0 Request processed in 579us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118113.791095:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789118113.791282:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314560:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789118113.791493:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789118113.791530:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1789118113.791543:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1789118113.791555:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1789118113.791567:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1789118113.791580:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1789118113.791592:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1789118113.791605:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1789118113.791617:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1789118113.791629:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1789118113.791640:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1789118113.791653:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1789118113.791697:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118113.791745:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118113.791880:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c7780 going to sleep for 11 seconds 00000100:00100000:2.0:1789118113.791952:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593314688 00000100:00100000:2.0:1789118113.791960:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593314688 00000100:00100000:3.0:1789118113.792048:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789118113.792082:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+19:24886:x1876025593314688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789118113.792326:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+19:24886:x1876025593314688:12345-0@lo:502:mount.lustre.0 Request processed in 248us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118113.792335:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789118113.792416:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789118113.792477:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1789118113.792490:0:24886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1789118113.803301:0:24903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789118113.803318:0:24903:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789118113.803350:0:24903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118113.803353:0:24903:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789118113.803361:0:24903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789118113.803379:0:24903:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff962a87e24ed8) 00000020:00000080:1.0:1789118113.803425:0:24903:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789118113.803435:0:24903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789118113.803530:0:24903:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962b90883800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789118113.803540:0:24903:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789118113.803548:0:24903:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa253ed19be21653 00010000:00010000:1.0:1789118113.810349:0:24903:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1789118113.811275:0:24903:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:2.0:1789118113.813895:0:24903:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/32) registered 00010000:00010000:3.0:1789118113.829650:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789118113.835519:0:24903:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789118113.835535:0:24903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789118113.835543:0:24903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118113.835546:0:24903:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789118113.835549:0:24903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789118113.835551:0:24903:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1789118113.835553:0:24903:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789118113.835554:0:24903:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789118113.835556:0:24903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789118113.835558:0:24903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118113.835559:0:24903:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789118113.835561:0:24903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789118113.835564:0:24903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118113.835565:0:24903:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789118113.835568:0:24903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789118113.835570:0:24903:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789118113.835572:0:24903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789118113.835575:0:24903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118113.835576:0:24903:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789118113.835578:0:24903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789118113.835581:0:24903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118113.835582:0:24903:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789118113.835585:0:24903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789118113.835628:0:24903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789118113.835632:0:24903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118113.835633:0:24903:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789118113.835637:0:24903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1789118113.842396:0:24886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789118113.842469:0:24886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789118113.842498:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be2163e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21645 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.842511:0:24886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70c200/0xaa253ed19be2163e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21645 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789118113.848839:0:24886:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b90883800 from 1 10000000:01000000:0.0:1789118113.848850:0:24886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789118113.848928:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118113.848940:0:24886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118113.848951:0:24886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118113.848978:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789118113.849076:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118113.849127:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf751000 going to sleep for 11 seconds 00000100:00100000:0.0:1789118113.850182:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593314816 00000100:00100000:0.0:1789118113.850198:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593314816 00000100:00100000:0.0:1789118113.850272:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789118113.850283:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+19:24886:x1876025593314816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789118113.850305:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789118113.850327:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b8ee65200/0xaa253ed19be21661 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be2165a expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118113.850378:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b8ee65200/0xaa253ed19be21661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be2165a expref: 20 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118113.850390:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b8ee65200/0xaa253ed19be21661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2165a expref: 20 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118113.850402:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b8ee65200, rc 0) 00000100:00100000:0.0:1789118113.850481:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:24886:x1876025593314816:12345-0@lo:101:mount.lustre.0 Request processed in 199us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118113.850487:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789118113.851293:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789118113.851321:0:24886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21661 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118113.851332:0:24886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21661 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789118113.852506:0:24886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000040:00080000:0.0:1789118113.852957:0:24886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789118113.853352:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789118113.853725:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789118113.853737:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789118113.853750:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789118113.853762:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789118113.853774:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789118113.853787:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789118113.853800:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 144 off9680 00000040:00080000:0.0:1789118113.853814:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9904 00000040:00080000:0.0:1789118113.853825:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10128 00000040:00080000:0.0:1789118113.853838:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 144 off10272 00000040:00080000:0.0:1789118113.853865:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10496 00000040:00080000:0.0:1789118113.853880:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 224 off10720 00000040:00080000:0.0:1789118113.853892:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10848 00000040:00080000:0.0:1789118113.853903:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off11072 00000040:00080000:0.0:1789118113.853915:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11296 00000040:00080000:0.0:1789118113.853926:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 128 off11424 00000040:00080000:0.0:1789118113.853941:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11648 00000040:00080000:0.0:1789118113.853945:0:24886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 18 count 19 00000100:00100000:0.0:1789118113.854031:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789118113.857488:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118113.857540:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf7516c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789118113.857606:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593314944 00000100:00100000:0.0:1789118113.857634:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593314944 00000100:00100000:0.0:1789118113.857702:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789118113.857712:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:24886:x1876025593314944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789118113.858009:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:24886:x1876025593314944:12345-0@lo:501:mount.lustre.0 Request processed in 297us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118113.858018:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789118113.858182:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593314944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789118113.858245:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789118113.858291:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118113.858351:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789118113.858406:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593315072 00000100:00100000:0.0:1789118113.858412:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593315072 00000100:00100000:0.0:1789118113.858450:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789118113.858458:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:24886:x1876025593315072:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789118113.858553:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:24886:x1876025593315072:12345-0@lo:503:mount.lustre.0 Request processed in 95us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118113.858560:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789118113.858624:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315072:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789118113.859098:0:24886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789118113.859284:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fabc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789118113.859334:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118113.859370:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9000 going to sleep for 11 seconds 00000100:00100000:1.0:1789118113.859979:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593315200 00000100:00100000:1.0:1789118113.859986:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593315200 00000100:00100000:1.0:1789118113.860035:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789118113.860044:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:24886:x1876025593315200:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118113.860251:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:24886:x1876025593315200:12345-0@lo:502:mount.lustre.0 Request processed in 208us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118113.860260:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789118113.860559:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fabc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315200:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789118113.861289:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789118113.861323:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789118113.861337:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789118113.861351:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789118113.861365:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789118113.861378:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789118113.861390:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789118113.862581:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 144 off9680 00000040:00080000:3.0:1789118113.862626:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9904 00000040:00080000:3.0:1789118113.862643:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10128 00000040:00080000:3.0:1789118113.862672:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 144 off10272 00000040:00080000:3.0:1789118113.862693:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10496 00000040:00080000:3.0:1789118113.862708:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 224 off10720 00000040:00080000:3.0:1789118113.862722:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10848 00000040:00080000:3.0:1789118113.862735:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off11072 00000040:00080000:3.0:1789118113.862749:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11296 00000040:00080000:3.0:1789118113.862763:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 128 off11424 00000100:00100000:3.0:1789118113.862817:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789118113.862899:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118113.862999:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789118113.863326:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593315328 00000100:00100000:0.0:1789118113.863337:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593315328 00000100:00100000:0.0:1789118113.863513:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789118113.863525:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:24886:x1876025593315328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789118113.863728:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:24886:x1876025593315328:12345-0@lo:502:mount.lustre.0 Request processed in 204us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118113.863737:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789118113.863937:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789118113.864015:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11648 00000040:00080000:3.0:1789118113.864026:0:24886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:1.0:1789118113.870573:0:24907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789118113.870588:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118113.870603:0:24907:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789118113.870612:0:24907:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962b90883800 00000020:00000080:1.0:1789118113.870615:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789118113.870624:0:24907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789118113.870626:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118113.870627:0:24907:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789118113.870629:0:24907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789118113.870632:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118113.870633:0:24907:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789118113.870636:0:24907:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962b90883800 00000020:00000080:1.0:1789118113.870638:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789118113.870716:0:24907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789118113.870729:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118113.870731:0:24907:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789118113.870734:0:24907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789118113.870736:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118113.870737:0:24907:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789118113.870741:0:24907:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962b90883800 00000020:00000080:1.0:1789118113.870744:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789118113.870762:0:24907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789118113.870765:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118113.870766:0:24907:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789118113.870769:0:24907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789118113.870771:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118113.870772:0:24907:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789118113.870775:0:24907:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962b90883800 00000020:00000080:1.0:1789118113.870777:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789118113.871284:0:24907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789118113.871292:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118113.871293:0:24907:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789118113.871297:0:24907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789118113.871299:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118113.871301:0:24907:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789118113.871304:0:24907:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962b90883800 00000020:00000080:1.0:1789118113.871306:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789118113.871332:0:24907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789118113.871335:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118113.871337:0:24907:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789118113.871339:0:24907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789118113.871341:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118113.871343:0:24907:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789118113.871346:0:24907:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962b90883800 00000020:00000080:1.0:1789118113.871348:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789118113.871389:0:24907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789118113.871393:0:24907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118113.871412:0:24907:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789118113.871415:0:24907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 19 count 19 00000020:01000000:3.0:1789118113.871618:0:24886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:3.0:1789118113.871658:0:24886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789118113.871691:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21661 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118113.871712:0:24886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21661 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118113.871771:0:24886:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789118113.871774:0:24886:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962b90883800 10000000:01000000:3.0:1789118113.871778:0:24886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962b90883800 10000000:01000000:3.0:1789118113.871782:0:24886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789118113.871788:0:24886:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962b90883800 from 1 10000000:01000000:3.0:1789118113.871799:0:24886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789118113.871837:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9b400/0xaa253ed19be21668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118113.871845:0:24886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a88d9b400/0xaa253ed19be21668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118113.871857:0:24886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a88d9b400/0xaa253ed19be21668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118113.871887:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789118113.871960:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118113.872013:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9900 going to sleep for 11 seconds 00000100:00100000:1.0:1789118113.872179:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593315456 00000100:00100000:1.0:1789118113.872188:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593315456 00000100:00100000:1.0:1789118113.872241:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789118113.872252:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:24886:x1876025593315456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789118113.872270:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118113.872285:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70dc00/0xaa253ed19be2166f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be21668 expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.872312:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70dc00/0xaa253ed19be2166f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be21668 expref: 21 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.872325:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70dc00/0xaa253ed19be2166f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be21668 expref: 21 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.872337:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70dc00, rc 0) 00000100:00100000:1.0:1789118113.872382:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:24886:x1876025593315456:12345-0@lo:101:mount.lustre.0 Request processed in 132us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118113.872390:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789118113.872601:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789118113.872620:0:24886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a88d9b400/0xaa253ed19be21668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be2166f expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118113.872629:0:24886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a88d9b400/0xaa253ed19be21668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be2166f expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789118113.876452:0:24886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1789118113.876901:0:24886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789118113.877113:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789118113.877213:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1789118113.877236:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1789118113.877248:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1789118113.877259:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1789118113.877272:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1789118113.877295:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1789118113.877307:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1789118113.877334:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789118113.877348:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1789118113.877363:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1789118113.877377:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1789118113.877392:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1789118113.877405:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1789118113.877419:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1789118113.877431:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1789118113.877443:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1789118113.877454:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1789118113.877465:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1789118113.877476:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1789118113.877488:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1789118113.877499:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1789118113.877510:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1789118113.877523:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1789118113.877551:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1789118113.877568:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1789118113.877582:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1789118113.877594:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1789118113.877607:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1789118113.877620:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1789118113.877634:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1789118113.877646:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1789118113.877673:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1789118113.877690:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1789118113.877706:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1789118113.877719:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1789118113.877733:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1789118113.877745:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1789118113.877757:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1789118113.877783:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1789118113.877811:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1789118113.877826:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1789118113.877838:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1789118113.877850:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1789118113.877863:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1789118113.877876:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1789118113.877890:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1789118113.877904:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1789118113.878029:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1789118113.878048:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1789118113.878102:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1789118113.878108:0:24886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1789118113.878993:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315584:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789118113.879106:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118113.880489:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593315584 00000100:00100000:0.0:1789118113.880504:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593315584 00000100:00100000:0.0:1789118113.880562:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789118113.880573:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:24886:x1876025593315584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789118113.880782:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:24886:x1876025593315584:12345-0@lo:501:mount.lustre.0 Request processed in 210us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118113.880790:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789118113.880839:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fec3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789118113.880864:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315584:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789118113.880922:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315712:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789118113.880974:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118113.880997:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fec3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789118113.881720:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593315712 00000100:00100000:1.0:1789118113.881730:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593315712 00000100:00100000:1.0:1789118113.881777:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789118113.881784:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:24886:x1876025593315712:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789118113.882035:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:24886:x1876025593315712:12345-0@lo:503:mount.lustre.0 Request processed in 251us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118113.882042:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789118113.882932:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315712:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789118113.883520:0:24886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789118113.883634:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315840:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789118113.883731:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118113.883789:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fec3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789118113.884572:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593315840 00000100:00100000:1.0:1789118113.884582:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593315840 00000100:00100000:1.0:1789118113.884646:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789118113.884657:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:24886:x1876025593315840:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118113.888374:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:24886:x1876025593315840:12345-0@lo:502:mount.lustre.0 Request processed in 3692us (4616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118113.888397:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789118113.888520:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315840:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789118113.888979:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789118113.889010:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789118113.889023:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789118113.889034:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789118113.889045:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789118113.889078:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789118113.889092:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789118113.889103:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789118113.889115:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789118113.889126:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789118113.889137:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789118113.889225:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789118113.889236:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789118113.889249:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789118113.889259:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789118113.889269:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789118113.889281:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789118113.889309:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789118113.889323:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789118113.889334:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789118113.889345:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789118113.889938:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789118113.889960:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789118113.889977:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789118113.890002:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1789118113.890018:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1789118113.890032:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1789118113.890046:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1789118113.890089:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1789118113.890105:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1789118113.890121:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1789118113.890137:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1789118113.890279:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1789118113.890310:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1789118113.890328:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1789118113.890343:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1789118113.891000:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789118113.891028:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789118113.891041:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789118113.891073:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789118113.891090:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789118113.891104:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789118113.891117:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789118113.891132:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789118113.891303:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789118113.891320:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789118113.891332:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789118113.891345:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789118113.891521:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315968:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118113.891768:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118113.891923:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85fec3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789118113.892611:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593315968 00000100:00100000:0.0:1789118113.892621:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593315968 00000100:00100000:0.0:1789118113.892688:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789118113.892699:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:24886:x1876025593315968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789118113.892846:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:24886:x1876025593315968:12345-0@lo:502:mount.lustre.0 Request processed in 148us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118113.892854:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789118113.893804:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed792c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593315968:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789118113.894031:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1789118113.894079:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1789118113.894128:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7252c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593316096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789118113.894193:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118113.894224:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593316096 00000100:00100000:1.0:1789118113.894230:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593316096 00000100:00100000:0.0:1789118113.894230:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf629480 going to sleep for 11 seconds 00000100:00100000:1.0:1789118113.894270:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789118113.894278:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:24886:x1876025593316096:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118113.894471:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:24886:x1876025593316096:12345-0@lo:502:mount.lustre.0 Request processed in 193us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118113.894479:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789118113.894925:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7252c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593316096:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789118113.894980:0:24886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1789118113.894990:0:24886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789118113.897825:0:24912:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789118113.897846:0:24912:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff962b8ee09a48) 00000020:00000080:0.0:1789118113.897883:0:24912:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789118113.897985:0:24912:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962b90883800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789118113.897991:0:24912:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962b90883800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789118113.897994:0:24912:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962b90883800 3 00010000:00080000:0.0:1789118113.898029:0:24912:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bc0e59000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.130@tcp at head 00010000:00010000:0.0:1789118113.899731:0:24912:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1789118113.899929:0:24912:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789118113.899975:0:24912:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789118113.900752:0:24912:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xaa253ed19be2167d 00000100:00080000:1.0:1789118113.900767:0:24912:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789118113.900774:0:24912:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff962bc0e59000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789118113.900886:0:24912:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b8ed78000 x1876025593316224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789118113.900923:0:24912:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789118113.901542:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593316352:0@lo:400:kworker.0 00000100:00100000:1.0:1789118113.901631:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118113.901712:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593316352 00000100:00100000:1.0:1789118113.901720:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593316352 00000100:00100000:1.0:1789118113.901764:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789118113.901773:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593316352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118113.901933:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593316352:12345-0@lo:400:kworker.0 Request processed in 160us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118113.901942:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789118113.901986:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593316352:0@lo:400:kworker.0 00000100:00080000:0.0:1789118113.905732:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118113.905741:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789118113.905744:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118113.905747:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789118113.905895:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593316480:0@lo:400:kworker.0 00000100:00100000:2.0:1789118113.905912:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593316224:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789118113.905968:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118113.905971:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789118113.905974:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118113.905977:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789118113.906098:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789118113.906110:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b9277fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593316736:0@lo:400:kworker.0 00000100:00100000:1.0:1789118113.906232:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118113.906273:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789118113.906278:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593316608:0@lo:400:kworker.0 00000100:00100000:1.0:1789118113.906310:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118113.906345:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593316480 00000100:00100000:0.0:1789118113.906430:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118113.906462:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593316736 00000100:00100000:0.0:1789118113.906469:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593316736 00000100:00100000:0.0:1789118113.906510:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789118113.906520:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9277e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593316736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118113.906582:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9277e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876025593316736:12345-0@lo:400:kworker.0 Request processed in 63us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118113.906590:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789118113.906628:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b9277fc00 x1876025593316736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118113.906643:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b9277fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876025593316736:0@lo:400:kworker.0 00000100:00100000:1.0:1789118113.906692:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593316480 00000100:00100000:1.0:1789118113.906725:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789118113.906731:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593316480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118113.906768:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593316480:12345-0@lo:400:kworker.0 Request processed in 37us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118113.906774:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789118113.906876:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593316608 00000100:00100000:1.0:1789118113.906880:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593316608 00000100:00100000:1.0:1789118113.906903:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789118113.906910:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593316608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118113.906944:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593316608:12345-0@lo:400:kworker.0 Request processed in 34us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118113.906949:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789118113.906978:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593316608:0@lo:400:kworker.0 00010000:00080000:1.0:1789118113.906988:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf7243c0 x1876025593316480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118113.906997:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593316480:0@lo:400:kworker.0 00000100:00100000:2.0:1789118113.909254:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118113.909376:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593316224 00000100:00100000:2.0:1789118113.909387:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593316224 00000100:00100000:2.0:1789118113.909424:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789118113.909433:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593316224:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789118113.909465:0:23377:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 766 last 0 00000020:00000080:2.0:1789118113.909503:0:23377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xaa253ed19be21684 00000004:00100000:2.0:1789118113.909521:0:23377:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789118113.909564:0:23377:0:(import.c:65:import_set_state_nolock()) ffff962bc0d52000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789118113.909645:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876025593316224:12345-0@lo:38:llog_process_th.0 Request processed in 212us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118113.909653:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789118113.909712:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b8ed78000 x1876025593316224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789118123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118113.909723:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789118113.909732:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1789118113.909741:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789118113.909745:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789118113.909748:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bc0e59000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789118113.909754:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876025593316224:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1789118113.910823:0:24912:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789118113.910840:0:24912:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff962bbcddced8) 00000020:00000080:2.0:1789118113.910862:0:24912:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1789118113.910965:0:24912:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962b90883800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789118113.910970:0:24912:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962b90883800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789118113.910973:0:24912:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962b90883800 3 00010000:00080000:2.0:1789118113.911003:0:24912:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962a89064800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.130@tcp at head 00010000:00010000:2.0:1789118113.916134:0:24912:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1789118113.916403:0:24912:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789118113.916464:0:24912:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789118113.916478:0:24912:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xaa253ed19be21692 00000100:00080000:2.0:1789118113.916491:0:24912:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789118113.916497:0:24912:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff962a89064800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789118113.916537:0:24912:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87f6a1c0 x1876025593316864/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789118113.916559:0:24912:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789118113.916655:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876025593316864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789118113.916755:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789118113.917706:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789118113.917713:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789118113.917716:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789118113.917719:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789118113.917723:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789118113.917726:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789118113.917728:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789118113.917739:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789118113.920117:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593316864 00000100:00100000:2.0:1789118113.920134:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593316864 00000100:00100000:2.0:1789118113.920187:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789118113.920197:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593316864:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789118113.920237:0:23377:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 766 last 0 00000020:00000080:2.0:1789118113.920290:0:23377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xaa253ed19be21699 00000004:00100000:2.0:1789118113.920311:0:23377:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789118113.920352:0:23377:0:(import.c:65:import_set_state_nolock()) ffff962a89062800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789118113.920453:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876025593316864:12345-0@lo:38:llog_process_th.0 Request processed in 256us (3697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118113.920461:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789118113.920509:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a87f6a1c0 x1876025593316864/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789118123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118113.920522:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789118113.920531:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1789118113.920539:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789118113.920544:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789118113.920546:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a89064800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789118113.920553:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876025593316864:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789118113.928895:0:24912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1789118113.929387:0:24886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789118113.929432:0:24886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789118113.929459:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9b400/0xaa253ed19be21668 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be2166f expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.929491:0:24886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a88d9b400/0xaa253ed19be21668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be2166f expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789118113.934242:0:24886:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789118113.934247:0:24886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789118113.934248:0:24886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789118113.934249:0:24886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789118113.934250:0:24886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789118113.934253:0:24886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789118113.934255:0:24886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789118113.934257:0:24886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789118113.934258:0:24886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789118113.934263:0:24886:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789118113.934266:0:24886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789118113.934267:0:24886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789118113.934268:0:24886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789118113.934269:0:24886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789118113.934270:0:24886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789118113.934271:0:24886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789118113.934272:0:24886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789118113.934273:0:24886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789118113.934274:0:24886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789118113.934304:0:24886:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789118113.934327:0:24886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593316992:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789118113.934406:0:24886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118113.934449:0:24886:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c22a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789118113.935885:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593316992 00000100:00100000:0.0:1789118113.935898:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593316992 00000100:00100000:0.0:1789118113.935956:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789118113.935973:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:24886:x1876025593316992:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789118113.936005:0:23370:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789118113.936019:0:23370:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789118113.947510:0:23370:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789118113.947534:0:23370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789118113.947738:0:23393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789118113.947744:0:23393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789118113.947774:0:23393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.947793:0:23393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b8ee64400/0xaa253ed19be215ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be215e3 expref: 21 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.947815:0:23393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d92e00/0xaa253ed19be215f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be215f1 expref: 21 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.947823:0:23393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.947868:0:23393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d92e00/0xaa253ed19be215f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be215f1 expref: 21 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.947885:0:23393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962a87d92e00/0xaa253ed19be215f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be215f1 expref: 21 pid: 23372 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118113.947900:0:23393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23393:1876025593317120:0@lo:104: 00000100:00100000:2.0:1789118113.947969:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789118113.948022:0:23393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b8ee64400/0xaa253ed19be215ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be215e3 expref: 21 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.948030:0:23393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b8ee64400/0xaa253ed19be215ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be215e3 expref: 21 pid: 23372 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118113.948038:0:23393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23393:1876025593317248:0@lo:104: 00000100:00100000:2.0:1789118113.948152:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118113.948171:0:23393:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87c22300 going to sleep for 11 seconds 00000100:00100000:2.0:1789118113.948204:0:23361:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789118113.948224:0:23361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593317120 00000100:00100000:2.0:1789118113.948231:0:23361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593317120 00000100:00100000:2.0:1789118113.948272:0:23361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593317248 00000100:00100000:2.0:1789118113.948274:0:23361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593317248 00000100:00100000:2.0:1789118113.948287:0:23361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789118113.948301:0:23361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+4:23393:x1876025593317120:12345-0@lo:104: 00010000:00010000:2.0:1789118113.948316:0:23361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be215f8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118113.948497:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:24886:x1876025593316992:12345-0@lo:253:mount.lustre.0 Request processed in 12524us (14090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118113.948507:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789118113.951437:0:23393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23393:1876025593317120:0@lo:104: 00000100:00100000:3.0:1789118113.953155:0:24886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:24886:1876025593316992:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789118113.953175:0:24886:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789118113.953178:0:24886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789118113.953180:0:24886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789118113.953181:0:24886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789118113.953182:0:24886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789118113.953183:0:24886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789118113.953185:0:24886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789118113.953186:0:24886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789118113.953188:0:24886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789118113.953189:0:24886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789118113.953211:0:24886:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789118113.957748:0:23361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789118113.957772:0:23361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+4:23393:x1876025593317120:12345-0@lo:104: Request processed in 9464us (9796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118113.957785:0:23361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789118113.957844:0:23361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789118113.957861:0:23361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8449a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+3:23393:x1876025593317248:12345-0@lo:104: 00010000:00010000:2.0:1789118113.957889:0:23361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be215ea expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118113.958032:0:23393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23393:1876025593317248:0@lo:104: 00010000:00010000:2.0:1789118113.965557:0:23393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.965621:0:23361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789118113.965633:0:23361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8449a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+3:23393:x1876025593317248:12345-0@lo:104: Request processed in 7777us (17476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118113.965646:0:23361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789118113.965721:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789118113.965729:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be215f8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.965737:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9a200 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789118113.965741:0:23366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be215f8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.965781:0:23366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be215f8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789118113.965790:0:23366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be215f8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789118113.965795:0:23366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789118113.965865:0:23366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be215f8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.965870:0:23366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789118113.965891:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be215f8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.965897:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be215f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be215f8 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.965910:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118113.965913:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be215ea expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.965917:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9ba00 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789118113.965920:0:23366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be215ea expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.965925:0:23366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be215ea expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789118113.965931:0:23366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be215ea expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789118113.965941:0:23366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789118113.965954:0:23366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be215ea expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.965960:0:23366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789118113.965975:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be215ea expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.965982:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a88d9ba00/0xaa253ed19be215e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be215ea expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118113.965996:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118113.965998:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118113.965999:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118113.966015:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593317376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789118113.966122:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118113.967376:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789118113.967410:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3645:1876025593317504:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789118113.969276:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118113.969733:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118113.969857:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593317376 00000100:00100000:1.0:1789118113.969866:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593317376 00010000:00010000:1.0:1789118113.969903:0:23362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d92e00/0xaa253ed19be215f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be215f1 expref: 21 pid: 23372 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118113.969944:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593317504 00000100:00100000:1.0:1789118113.969948:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593317504 00010000:00010000:1.0:1789118113.969959:0:23362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b8ee64400/0xaa253ed19be215ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be215e3 expref: 22 pid: 23372 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118113.969974:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789118113.969982:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:3647:x1876025593317376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789118113.969997:0:23362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789118113.970003:0:23362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d92e00/0xaa253ed19be215f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be215f1 expref: 22 pid: 23372 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.970016:0:23362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d92e00/0xaa253ed19be215f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be215f1 expref: 22 pid: 23372 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.970034:0:23362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92e00/0xaa253ed19be215f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be215f1 expref: 22 pid: 23372 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.970048:0:23362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789118113.970124:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:3647:x1876025593317376:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (4002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118113.970132:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789118113.970348:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789118113.970355:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b87ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:3645:x1876025593317504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789118113.970376:0:23362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789118113.970381:0:23362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b8ee64400/0xaa253ed19be215ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be215e3 expref: 20 pid: 23372 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.970390:0:23362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b8ee64400/0xaa253ed19be215ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be215e3 expref: 20 pid: 23372 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.970400:0:23362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b8ee64400/0xaa253ed19be215ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be215e3 expref: 20 pid: 23372 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.970412:0:23362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.970421:0:23362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789118113.970440:0:23362:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.022695690s 00010000:00010000:1.0:1789118113.970444:0:23362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.970450:0:23362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.970457:0:23362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.970463:0:23362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.970469:0:23362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93c00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789118113.970473:0:23362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.970486:0:23362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.970505:0:23362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118113.970515:0:23362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789118113.970553:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b87ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+19:3645:x1876025593317504:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118113.970560:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789118113.970806:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593317376:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1789118113.972502:0:24886:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1789118113.980882:0:24886:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789118113.980894:0:24886:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789118113.980934:0:24886:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789118113.981010:0:24886:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789118113.981038:0:24886:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789118113.981085:0:24886:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789118113.986122:0:24886:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789118113.986474:0:24886:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789118113.987689:0:23393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118113.987706:0:23393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118113.987714:0:23393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d93c00/0xaa253ed19be216a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118113.987785:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3645:1876025593317504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789118114.854517:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789118115.117601:0:24968:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789118115.117879:0:24968:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1789118115.686544:0:23375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789118115.686550:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962bbf6a7800 from 13 10000000:01000000:3.0:1789118115.686556:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789118115.686609:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118115.686622:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118115.686662:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118115.686693:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593317632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789118115.686800:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118115.686878:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae8d2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789118115.686883:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593317632 00000100:00100000:1.0:1789118115.686893:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593317632 00000100:00100000:1.0:1789118115.686974:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789118115.686987:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+19:23375:x1876025593317632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789118115.687006:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118115.687026:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbf70d000/0xaa253ed19be216ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be216a7 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118115.687102:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbf70d000/0xaa253ed19be216ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be216a7 expref: 20 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118115.687116:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbf70d000/0xaa253ed19be216ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be216a7 expref: 20 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118115.687129:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbf70d000, rc 0) 00000100:00100000:1.0:1789118115.687179:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:23375:x1876025593317632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118115.687187:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789118115.689555:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593317632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789118115.690477:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be216ae expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118115.690493:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be216ae expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118115.690586:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593317760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789118115.690670:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118115.690719:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae8d2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789118115.694103:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593317760 00000100:00100000:1.0:1789118115.694115:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593317760 00000100:00100000:1.0:1789118115.694175:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789118115.694184:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:23375:x1876025593317760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789118115.694219:0:23370:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789118115.694235:0:23370:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789118115.694238:0:23370:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1789118115.694370:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:23375:x1876025593317760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 187us (3700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118115.694378:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789118115.694430:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593317760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789118115.694776:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789118115.694787:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be216ae expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118115.694797:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be216ae expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118115.694807:0:23375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789118115.694809:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962a8795a800 from 13 10000000:01000000:1.0:1789118115.694812:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789118115.694849:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118115.694856:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118115.694865:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118115.694899:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593317888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789118115.694936:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118115.694973:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789118115.695647:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593317888 00000100:00100000:2.0:1789118115.695654:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593317888 00000100:00100000:2.0:1789118115.695702:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789118115.695713:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:23375:x1876025593317888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789118115.695731:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118115.695750:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92000/0xaa253ed19be216bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be216b5 expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118115.695787:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92000/0xaa253ed19be216bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be216b5 expref: 21 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118115.695799:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92000/0xaa253ed19be216bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be216b5 expref: 21 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118115.695809:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92000, rc 0) 00000100:00100000:2.0:1789118115.697608:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:23375:x1876025593317888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1887us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118115.697622:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789118115.700846:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593317888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789118115.700893:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be216bc expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118115.700910:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be216bc expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118115.701151:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593318016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789118115.701238:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118115.701280:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5cd4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789118115.701399:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593318016 00000100:00100000:0.0:1789118115.701409:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593318016 00000100:00100000:0.0:1789118115.701472:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789118115.701482:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:23375:x1876025593318016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789118115.702414:0:23372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789118115.702439:0:23372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789118115.702442:0:23372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789118115.703048:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:23375:x1876025593318016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1564us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118115.703075:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789118115.705694:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593318016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789118115.705809:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789118115.705824:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be216bc expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118115.705835:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be216bc expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118115.877469:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118116.200291:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789118116.200315:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593318144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789118116.200389:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118116.200443:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593318144 00000100:00100000:2.0:1789118116.200450:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593318144 00000100:00100000:2.0:1789118116.200497:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789118116.200507:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593318144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789118116.200547:0:24121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789118116.200597:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593318144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118116.200604:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789118116.200668:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593318144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789118116.207449:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789118116.207480:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593318272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789118116.207555:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118116.207655:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593318272 00000100:00100000:1.0:1789118116.207664:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593318272 00000100:00100000:1.0:1789118116.207727:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789118116.207738:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593318272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789118116.207776:0:23382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789118116.207830:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593318272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118116.207837:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789118116.207883:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593318272:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789118116.906390:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789118117.160900:0:24138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789118117.933355:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118118.951650:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789118119.269502:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789118119.269510:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789118119.269513:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789118119.269530:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789118119.269547:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789118119.269550:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789118119.269552:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789118119.269555:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789118119.269612:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593318784:0@lo:400:kworker.0 00000100:00100000:2.0:1789118119.269685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118119.269730:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789118119.269818:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593318400:0@lo:400:kworker.0 00000100:00100000:2.0:1789118119.269853:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118119.269883:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593318912:0@lo:400:kworker.0 00000100:00100000:2.0:1789118119.269906:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118119.269932:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593318528:0@lo:400:kworker.0 00000100:00100000:2.0:1789118119.269956:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118119.269971:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593319040:0@lo:400:kworker.0 00000100:00100000:2.0:1789118119.269991:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118119.270008:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789118119.270013:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593318656:0@lo:400:kworker.0 00000100:00100000:2.0:1789118119.270033:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118119.270049:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593319168:0@lo:400:kworker.0 00000100:00100000:2.0:1789118119.270093:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118119.270116:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593318784 00000100:00100000:2.0:1789118119.270123:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593318784 00000100:00100000:3.0:1789118119.270265:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593318912 00000100:00100000:3.0:1789118119.270270:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593318912 00000100:00100000:3.0:1789118119.270306:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593319040 00000100:00100000:3.0:1789118119.270309:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593319040 00000100:00100000:3.0:1789118119.270332:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593318656 00000100:00100000:3.0:1789118119.270335:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593318656 00000100:00100000:3.0:1789118119.270345:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593319168 00000100:00100000:3.0:1789118119.270347:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593319168 00000100:00100000:3.0:1789118119.270365:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789118119.270382:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593318912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118119.270441:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593318912:12345-0@lo:400:kworker.0 Request processed in 61us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118119.270448:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789118119.270469:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789118119.270476:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593319040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118119.270508:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593319040:12345-0@lo:400:kworker.0 Request processed in 33us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118119.270514:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789118119.270526:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789118119.270533:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593318656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118119.270568:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593318656:12345-0@lo:400:kworker.0 Request processed in 25us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118119.270575:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789118119.270587:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789118119.270593:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593319168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118119.270619:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593319168:12345-0@lo:400:kworker.0 Request processed in 27us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118119.270624:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789118119.270688:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789118119.270692:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789118119.271084:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593318528 00000100:00100000:1.0:1789118119.271090:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593318528 00000100:00100000:1.0:1789118119.271152:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789118119.271160:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eeded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593318528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118119.271202:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eeded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593318528:12345-0@lo:400:kworker.0 Request processed in 44us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118119.271209:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789118119.271283:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a87d9cb40 x1876025593318656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118119.271298:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593318656:0@lo:400:kworker.0 00010000:00080000:1.0:1789118119.271316:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b8eedcb40 x1876025593319168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118119.271324:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593319168:0@lo:400:kworker.0 00000100:00100000:1.0:1789118119.271335:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593318528:0@lo:400:kworker.0 00010000:00080000:1.0:1789118119.271348:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b8eedc000 x1876025593319040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118119.271356:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593319040:0@lo:400:kworker.0 00010000:00080000:1.0:1789118119.271535:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b8eedd680 x1876025593318912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118119.271544:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593318912:0@lo:400:kworker.0 00000100:00100000:2.0:1789118119.275495:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789118119.275512:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593318784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118119.275630:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593318784:12345-0@lo:400:kworker.0 Request processed in 122us (5944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118119.275638:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789118119.275672:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593318400 00000100:00100000:2.0:1789118119.275680:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593318400 00000100:00100000:2.0:1789118119.275710:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789118119.275716:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:3646:x1876025593318400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118119.276248:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:3646:x1876025593318400:12345-0@lo:400:kworker.0 Request processed in 530us (6392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118119.276256:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789118119.276321:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593318400:0@lo:400:kworker.0 00000100:00100000:2.0:1789118119.276335:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593318784:0@lo:400:kworker.0 00000040:00080000:1.0:1789118119.591832:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789118119.977366:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118120.102173:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789118105/real 1789118105] req@ffff962a87f68f00 x1876025593312000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118120 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118120.102206:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962a87f68f00 x1876025593312000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118120 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118120.102228:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789118105/real 1789118105] req@ffff962a87f6a940 x1876025593312128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118120 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118120.102242:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962a87f6a940 x1876025593312128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118120 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789118120.102265:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a88711800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789118120.102280:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789118120.102284:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593312000:0@lo:8:kworker.0 00000100:00080000:3.0:1789118120.102292:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a86836000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789118120.102297:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789118120.102300:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593312128:0@lo:8:kworker.0 00000100:00080000:0.0:1789118120.102524:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118120.102528:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789118120.102531:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118120.102534:0:24392:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789118120.102567:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118120.102570:0:24392:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789118120.102574:0:24392:0:(import.c:65:import_set_state_nolock()) ffff962a88711800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789118120.102579:0:24392:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 758 00000100:00080000:0.0:1789118120.102590:0:24392:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789118120.102597:0:24392:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff962a88711800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:1.0:1789118120.102694:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593319424:0@lo:400:kworker.0 00000100:00100000:1.0:1789118120.102755:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118120.102790:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789118120.102795:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593319296:0@lo:400:kworker.0 00000100:00100000:1.0:1789118120.102829:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118120.102865:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a32d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593319552:0@lo:400:kworker.0 00000100:00100000:1.0:1789118120.102890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118120.102908:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789118120.102913:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593319680:0@lo:400:kworker.0 00000100:00100000:1.0:1789118120.102934:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118120.102962:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593319424 00000100:00100000:1.0:1789118120.102970:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593319424 00000100:00100000:1.0:1789118120.103022:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593319680 00000100:00100000:1.0:1789118120.103026:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593319680 00000100:00100000:1.0:1789118120.103043:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789118120.103133:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593319424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118120.103191:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593319424:12345-0@lo:400:kworker.0 Request processed in 139us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118120.103200:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789118120.103217:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789118120.103223:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593319680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118120.103259:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593319680:12345-0@lo:400:kworker.0 Request processed in 36us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118120.103264:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789118120.103283:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593319296 00000100:00100000:1.0:1789118120.103287:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593319296 00000100:00100000:1.0:1789118120.103312:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789118120.103318:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:3647:x1876025593319296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118120.103350:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:3647:x1876025593319296:12345-0@lo:400:kworker.0 Request processed in 32us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118120.103364:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789118120.103421:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593319680:0@lo:400:kworker.0 00000100:00100000:1.0:1789118120.103445:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3647:1876025593319296:0@lo:400:kworker.0 00000100:00100000:1.0:1789118120.103453:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593319424:0@lo:400:kworker.0 00000100:00100000:0.0:1789118120.103631:0:24392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b98a312c0 x1876025593319808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789118120.103663:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789118120.103667:0:24392:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789118120.103669:0:24392:0:(import.c:65:import_set_state_nolock()) ffff962a86836000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789118120.103674:0:24392:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 758 00000100:00080000:0.0:1789118120.103677:0:24392:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789118120.103681:0:24392:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962a86836000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:0.0:1789118120.103704:0:24392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b98a303c0 x1876025593319936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789118120.103812:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593320064:0@lo:400:kworker.0 00000100:00100000:3.0:1789118120.103846:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118120.103881:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789118120.103886:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593320192:0@lo:400:kworker.0 00000100:00100000:3.0:1789118120.103914:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118120.103936:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789118120.103944:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593320320:0@lo:400:kworker.0 00000100:00100000:3.0:1789118120.103972:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118120.104008:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593319552 00000100:00100000:3.0:1789118120.104012:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593319552 00000100:00100000:3.0:1789118120.104037:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593320064 00000100:00100000:3.0:1789118120.104040:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593320064 00000100:00100000:3.0:1789118120.104050:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593320192 00000100:00100000:3.0:1789118120.104079:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593320192 00000100:00100000:3.0:1789118120.104095:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593320320 00000100:00100000:3.0:1789118120.104105:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593320320 00000100:00100000:3.0:1789118120.104124:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789118120.104130:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593319552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118120.104165:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593319552:12345-0@lo:400:kworker.0 Request processed in 36us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118120.104172:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789118120.104186:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789118120.104192:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593320064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118120.104223:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593320064:12345-0@lo:400:kworker.0 Request processed in 31us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118120.104229:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789118120.104241:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789118120.104246:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593320192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118120.104272:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593320192:12345-0@lo:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118120.104278:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789118120.104289:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789118120.104294:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593320320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118120.104324:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593320320:12345-0@lo:400:kworker.0 Request processed in 30us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118120.104329:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789118120.104357:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b98a330c0 x1876025593320320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118120.104367:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593320320:0@lo:400:kworker.0 00010000:00080000:3.0:1789118120.104392:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b98a30f00 x1876025593320192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118120.104409:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593320192:0@lo:400:kworker.0 00010000:00080000:3.0:1789118120.104421:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b98a31a40 x1876025593320064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118120.104429:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593320064:0@lo:400:kworker.0 00010000:00080000:1.0:1789118120.104603:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b98a32d00 x1876025593319552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118120.104612:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a32d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593319552:0@lo:400:kworker.0 00000100:00100000:1.0:1789118120.104632:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593319808:0@lo:8:kworker.0 00000100:00100000:1.0:1789118120.104661:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118120.104688:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593319936:0@lo:8:kworker.0 00000100:00100000:1.0:1789118120.104708:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118120.104789:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593319808 00000100:00100000:3.0:1789118120.104794:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593319808 00000100:00100000:3.0:1789118120.104818:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593319936 00000100:00100000:3.0:1789118120.104820:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593319936 00000100:00100000:3.0:1789118120.104829:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789118120.104833:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593319808:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789118120.104858:0:24890:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 772 last 0 00000020:00000080:3.0:1789118120.104883:0:24890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be216c3 00002000:00100000:3.0:1789118120.104896:0:24890:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff962bb5d6e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789118120.104900:0:24890:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789118120.104902:0:24890:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789118120.105243:0:24890:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789118120.105268:0:24890:0:(import.c:65:import_set_state_nolock()) ffff962bb5d68800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789118120.105353:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876025593319808:12345-0@lo:8:kworker.0 Request processed in 517us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118120.105360:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789118120.105376:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789118120.105380:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593319936:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789118120.105392:0:24890:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789118120.105419:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593319936:12345-0@lo:8:kworker.0 Request processed in 37us (709us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789118120.105433:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789118120.108997:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b98a312c0 x1876025593319808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789118140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118120.109015:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789118120.109025:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789118120.109037:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789118120.109043:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789118120.109047:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a88711800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789118120.109166:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789118120.109176:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593319808:0@lo:8:kworker.0 00000100:00080000:1.0:1789118120.109198:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a86836000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789118120.109202:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789118120.109205:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593319936:0@lo:8:kworker.0 00000004:00080000:0.0:1789118120.109393:0:24123:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789118120.109421:0:24123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a30780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24123:1876025593320576:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789118120.109503:0:24123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118120.109530:0:24123:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84b7b3c0 going to sleep for 11 seconds 00000004:00080000:0.0:1789118120.109556:0:24122:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789118120.109671:0:24122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 772392616057ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789118120.109679:0:24122:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789118120.109770:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593320576 00000100:00100000:1.0:1789118120.109777:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593320576 00000100:00100000:1.0:1789118120.109850:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789118120.109861:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a32940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24123:x1876025593320576:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:0.0:1789118120.110090:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789118120.110331:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593320448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789118120.110379:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789118120.113745:0:24113:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1789118120.114595:0:24892:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789118120.114603:0:24892:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1789118120.114769:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a32940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24123:x1876025593320576:12345-0@lo:7:osp-pre-0-1.0 Request processed in 4904us (5260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118120.114782:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789118120.116335:0:24893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593320448 00000100:00100000:0.0:1789118120.116350:0:24893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593320448 00000100:00100000:0.0:1789118120.116404:0:24893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789118120.116414:0:24893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876025593320448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789118120.116451:0:24893:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789118120.116536:0:24893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876025593320448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (6156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118120.116564:0:24893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789118120.117482:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b98a33c00 x1876025593320448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789118136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118120.117508:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a33c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593320448:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789118120.123177:0:24123:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b98a30780 x1876025593320576/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789118136 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118120.123200:0:24123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a30780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24123:1876025593320576:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1789118120.123215:0:24123:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789118120.123267:0:24123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24123:1876025593320704:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789118120.123340:0:24123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118120.123386:0:24123:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae8d26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789118120.123430:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593320704 00000100:00100000:1.0:1789118120.123438:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593320704 00000100:00100000:1.0:1789118120.123492:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789118120.123501:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24123:x1876025593320704:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789118120.123533:0:24891:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789118120.123608:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24123:x1876025593320704:12345-0@lo:5:osp-pre-0-1.0 Request processed in 108us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118120.123616:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789118120.123647:0:24123:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b8ed7a1c0 x1876025593320704/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789118136 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118120.123657:0:24123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24123:1876025593320704:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789118120.123666:0:24123:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789118120.123698:0:24123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24123:1876025593320832:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789118120.123721:0:24123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118120.123739:0:24123:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae8d26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789118120.123750:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593320832 00000100:00100000:1.0:1789118120.123754:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593320832 00000100:00100000:1.0:1789118120.123775:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789118120.123782:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24123:x1876025593320832:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789118120.123808:0:24892:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:0.0:1789118120.148488:0:24887:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1789118120.148507:0:24887:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789118120.148763:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:24123:x1876025593320832:12345-0@lo:5:osp-pre-0-1.0 Request processed in 24974us (25034us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789118120.148775:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789118120.148864:0:24123:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b8ed7a1c0 x1876025593320832/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789118136 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118120.148876:0:24123:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1789118120.148883:0:24123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24123:1876025593320832:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789118120.148898:0:24123:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1789118120.148951:0:24123:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a33c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:24123:1876025593320960:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789118120.149203:0:24123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118120.149269:0:24123:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84b7b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789118120.155538:0:23389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593320960 00000100:00100000:3.0:1789118120.155565:0:23389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593320960 00000100:00100000:3.0:1789118120.155656:0:23388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789118120.155668:0:23388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24123:x1876025593320960:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789118120.155775:0:23388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24123:x1876025593320960:12345-0@lo:900:osp-pre-0-1.0 Request processed in 109us (6572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118120.155783:0:23388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789118120.155835:0:24123:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b98a33c00 x1876025593320960/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789118136 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118120.155849:0:24123:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a33c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:24123:1876025593320960:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1789118120.997278:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118121.317499:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593321088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789118121.317583:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118121.317660:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593321088 00000100:00100000:3.0:1789118121.317668:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593321088 00000100:00100000:3.0:1789118121.317717:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789118121.317726:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593321088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789118121.317762:0:24121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789118121.317810:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593321088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118121.317913:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789118121.317969:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593321088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789118121.327277:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789118121.327308:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593321216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789118121.327385:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118121.330273:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593321216 00000100:00100000:2.0:1789118121.330289:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593321216 00000100:00100000:2.0:1789118121.330361:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789118121.330372:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593321216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789118121.330709:0:23382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789118121.330795:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593321216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 425us (3409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118121.330804:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789118121.330946:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593321216:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1789118121.697001:0:25258:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789118122.037859:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118122.155006:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789118102/real 1789118102] req@ffff962bbf726940 x1876025593310336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118122 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118122.155044:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962bbf726940 x1876025593310336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118122 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118122.155085:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789118102/real 1789118102] req@ffff962bbf7270c0 x1876025593310464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118122 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118122.155098:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff962bbf7270c0 x1876025593310464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789118122 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789118122.155139:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbce12800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789118122.155160:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789118122.155166:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf726940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593310336:0@lo:8:kworker.0 00000100:00080000:0.0:1789118122.155172:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b90578800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789118122.155177:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789118122.155180:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593310464:0@lo:8:kworker.0 00000100:00080000:2.0:1789118122.155321:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789118122.155325:0:24392:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789118122.155328:0:24392:0:(import.c:65:import_set_state_nolock()) ffff962bbce12800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789118122.155333:0:24392:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 755 00000100:00080000:2.0:1789118122.155338:0:24392:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789118122.155344:0:24392:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff962bbce12800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789118122.155366:0:24392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b8eedf840 x1876025593321600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789118122.155377:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789118122.155380:0:24392:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789118122.155381:0:24392:0:(import.c:65:import_set_state_nolock()) ffff962b90578800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789118122.155384:0:24392:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 755 00000100:00080000:2.0:1789118122.155386:0:24392:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789118122.155389:0:24392:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b90578800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789118122.155400:0:24392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b8eede580 x1876025593321728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789118122.155436:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789118122.155439:0:24392:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789118122.155440:0:24392:0:(import.c:65:import_set_state_nolock()) ffff962a86836000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789118122.155443:0:24392:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 772 00000100:00080000:2.0:1789118122.155446:0:24392:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789118122.155449:0:24392:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962a86836000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:2.0:1789118122.155459:0:24392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962b8eedd680 x1876025593322240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789118122.155530:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eede940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593321856:0@lo:400:kworker.0 00000100:00100000:2.0:1789118122.155607:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118122.155645:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593322496:0@lo:400:kworker.0 00000100:00100000:2.0:1789118122.155669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118122.155690:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789118122.155696:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593321984:0@lo:400:kworker.0 00000100:00100000:2.0:1789118122.155719:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118122.155735:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593322624:0@lo:400:kworker.0 00000100:00100000:2.0:1789118122.155753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118122.155806:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593321856 00000100:00100000:2.0:1789118122.155815:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593321856 00000100:00100000:2.0:1789118122.155853:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593322496 00000100:00100000:2.0:1789118122.155855:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593322496 00000100:00100000:2.0:1789118122.155877:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593322624 00000100:00100000:2.0:1789118122.155880:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593322624 00000100:00100000:2.0:1789118122.155895:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789118122.155904:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593321856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118122.155951:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593321856:12345-0@lo:400:kworker.0 Request processed in 48us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118122.155959:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789118122.155975:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789118122.155981:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593322496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118122.156008:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593322496:12345-0@lo:400:kworker.0 Request processed in 28us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118122.156013:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789118122.156034:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789118122.156040:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593322624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118122.156090:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593322624:12345-0@lo:400:kworker.0 Request processed in 51us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118122.156097:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789118122.156118:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593321984 00000100:00100000:2.0:1789118122.156122:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593321984 00000100:00100000:2.0:1789118122.156145:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789118122.156152:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593321984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118122.156185:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593321984:12345-0@lo:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118122.156191:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789118122.156209:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789118122.156213:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789118122.156240:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593321984:0@lo:400:kworker.0 00010000:00080000:2.0:1789118122.156250:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b988a2580 x1876025593322624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118122.156259:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593322624:0@lo:400:kworker.0 00010000:00080000:2.0:1789118122.156267:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b8eede940 x1876025593321856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118122.156275:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eede940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593321856:0@lo:400:kworker.0 00010000:00080000:2.0:1789118122.156283:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b8eedcb40 x1876025593322496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118122.156290:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593322496:0@lo:400:kworker.0 00000100:00100000:3.0:1789118122.156497:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593321344:0@lo:400:kworker.0 00000100:00100000:3.0:1789118122.156549:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118122.156587:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593322112:0@lo:400:kworker.0 00000100:00100000:3.0:1789118122.156618:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118122.156637:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789118122.156644:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593321472:0@lo:400:kworker.0 00000100:00100000:3.0:1789118122.156667:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118122.156685:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593322368:0@lo:400:kworker.0 00000100:00100000:3.0:1789118122.156705:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118122.156729:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593321472 00000100:00100000:3.0:1789118122.156733:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593321472 00000100:00100000:3.0:1789118122.156761:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789118122.156768:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593321472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118122.156804:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593321472:12345-0@lo:400:kworker.0 Request processed in 38us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118122.156810:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789118122.156838:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593321472:0@lo:400:kworker.0 00000100:00100000:2.0:1789118122.157017:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593321344 00000100:00100000:2.0:1789118122.157021:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593321344 00000100:00100000:2.0:1789118122.157082:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789118122.157089:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:3644:x1876025593321344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118122.157125:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:3644:x1876025593321344:12345-0@lo:400:kworker.0 Request processed in 37us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118122.157131:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789118122.157163:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593321344:0@lo:400:kworker.0 00000100:00100000:2.0:1789118122.157180:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593322368 00000100:00100000:2.0:1789118122.157183:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593322368 00000100:00100000:2.0:1789118122.157206:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789118122.157212:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593322368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118122.157244:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593322368:12345-0@lo:400:kworker.0 Request processed in 32us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118122.157251:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789118122.157275:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b8eedc000 x1876025593322368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118122.157284:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593322368:0@lo:400:kworker.0 00000100:00100000:0.0:1789118122.157540:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593321600:0@lo:8:kworker.0 00000100:00100000:0.0:1789118122.157580:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118122.157615:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eede580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593321728:0@lo:8:kworker.0 00000100:00100000:0.0:1789118122.157642:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118122.157657:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593322240:0@lo:8:kworker.0 00000100:00100000:0.0:1789118122.157678:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118122.157795:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593322112 00000100:00100000:1.0:1789118122.157801:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593322112 00000100:00100000:1.0:1789118122.157839:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593321600 00000100:00100000:1.0:1789118122.157842:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593321600 00000100:00100000:1.0:1789118122.157851:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593321728 00000100:00100000:1.0:1789118122.157854:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593321728 00000100:00100000:1.0:1789118122.157860:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593322240 00000100:00100000:1.0:1789118122.157862:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593322240 00000100:00100000:1.0:1789118122.157870:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789118122.157877:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593322112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118122.157920:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593322112:12345-0@lo:400:kworker.0 Request processed in 44us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118122.157927:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789118122.157941:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789118122.157945:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876025593321600:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789118122.158138:0:24891:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 774 last 0 00000020:00000080:1.0:1789118122.158166:0:24891:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be216ca 00002000:00100000:1.0:1789118122.158181:0:24891:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff962a8844a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789118122.158185:0:24891:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789118122.158188:0:24891:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789118122.158268:0:24891:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789118122.158297:0:24891:0:(import.c:65:import_set_state_nolock()) ffff962a88448800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789118122.158339:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876025593321600:12345-0@lo:8:kworker.0 Request processed in 391us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118122.158347:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789118122.158361:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789118122.158366:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876025593321728:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789118122.158376:0:24891:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789118122.158401:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876025593321728:12345-0@lo:8:kworker.0 Request processed in 34us (759us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789118122.158408:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789118122.158418:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789118122.158422:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a32d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876025593322240:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789118122.158431:0:24891:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789118122.158452:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a32d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876025593322240:12345-0@lo:8:kworker.0 Request processed in 28us (773us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789118122.158457:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789118122.158499:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b8eedfc00 x1876025593322112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789118138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118122.158522:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593322112:0@lo:400:kworker.0 00010000:00080000:1.0:1789118122.158562:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b8eedf840 x1876025593321600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789118147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118122.158571:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789118122.158578:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789118122.158589:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789118122.158594:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789118122.158597:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bbce12800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789118122.158613:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789118122.158619:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593321600:0@lo:8:kworker.0 00000100:00080000:1.0:1789118122.158632:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b90578800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789118122.158636:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789118122.158639:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eede580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593321728:0@lo:8:kworker.0 00000100:00080000:1.0:1789118122.158647:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a86836000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789118122.158651:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789118122.158653:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593322240:0@lo:8:kworker.0 00000004:00080000:1.0:1789118122.158716:0:23402:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:1.0:1789118122.158740:0:23402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87d9f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23402:1876025593322880:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789118122.158772:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118122.158791:0:23402:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b886050c0 going to sleep for 11 seconds 00000004:00080000:1.0:1789118122.158811:0:23401:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789118122.158895:0:23401:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774441840206ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789118122.158903:0:23401:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789118122.158927:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789118122.158936:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8ed7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593322752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789118122.158980:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118122.159114:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593322880 00000100:00100000:3.0:1789118122.159120:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593322880 00000100:00100000:3.0:1789118122.159157:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789118122.159164:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:23402:x1876025593322880:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1789118122.162706:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1789118122.165812:0:24890:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789118122.165832:0:24890:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1789118122.165840:0:24890:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:1.0:1789118122.177016:0:23357:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789118122.177351:0:24893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593322752 00000100:00100000:0.0:1789118122.177364:0:24893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593322752 00000100:00100000:0.0:1789118122.177441:0:24893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789118122.177451:0:24893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876025593322752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789118122.177491:0:24893:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789118122.177630:0:24893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876025593322752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (18648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118122.177638:0:24893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789118122.177702:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962b8ed7a1c0 x1876025593322752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789118138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118122.177727:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8ed7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593322752:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1789118122.205805:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.205831:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be216d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.205856:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.205862:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.206637:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be216d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.206670:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be216d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.206684:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be216d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.206694:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be216d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.206724:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789118122.207202:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789118122.207227:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be216d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.207236:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70de00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118122.207240:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be216d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.207250:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be216d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.207271:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be216d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.207278:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be216d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.207304:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118122.207306:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118122.207307:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789118122.208768:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.208781:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.208797:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.208802:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.208808:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.208837:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.208848:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.208855:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.208928:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789118122.212763:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789118122.212779:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be216df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.212820:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=774s v=(0 0) 00010000:00010000:2.0:1789118122.212826:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118122.212833:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be216df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.212850:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be216df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.212863:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be216df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.212877:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be216df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.216784:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789118122.216804:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.216820:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118122.216825:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.216838:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.216883:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.216893:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.216928:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118122.216933:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be216df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.216940:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92c00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118122.216944:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be216df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.217209:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be216df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.217238:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be216df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.217248:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.217250:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.217252:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118122.219277:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789118122.219291:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be216df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789118122.220421:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.220432:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be216e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.220449:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.220454:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.220460:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be216e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.220475:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be216e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.220486:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be216e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.220519:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be216e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.225044:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789118122.225288:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be216e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.225304:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118122.225310:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be216e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.225356:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be216e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.225382:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be216e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.225392:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118122.225394:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118122.225396:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118122.226694:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789118122.226706:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be216e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789118122.228543:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.228557:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4f57dda/0xaa253ed19be216ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.228573:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.228579:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.228586:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f57dda/0xaa253ed19be216ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.228600:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4f57dda/0xaa253ed19be216ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.228610:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4f57dda/0xaa253ed19be216ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.228617:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f57dda/0xaa253ed19be216ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.232835:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118122.232853:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4f57dda/0xaa253ed19be216ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.232868:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70cc00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118122.232889:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f57dda/0xaa253ed19be216ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.232903:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f57dda/0xaa253ed19be216ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.232928:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4f57dda/0xaa253ed19be216ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.232938:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.232939:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.232949:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118122.233349:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789118122.233360:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4f57dda/0xaa253ed19be216ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.233625:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789118122.235390:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.235404:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000343ff11/0xaa253ed19be216f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.235419:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.235424:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.235430:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000343ff11/0xaa253ed19be216f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.235445:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000343ff11/0xaa253ed19be216f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.235455:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000343ff11/0xaa253ed19be216f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.235463:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000343ff11/0xaa253ed19be216f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.235488:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789118122.235729:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118122.235737:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000343ff11/0xaa253ed19be216f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.235758:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118122.235763:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000343ff11/0xaa253ed19be216f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.235773:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000343ff11/0xaa253ed19be216f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.235791:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000343ff11/0xaa253ed19be216f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.235798:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000343ff11/0xaa253ed19be216f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.235817:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.235819:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.235821:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789118122.236456:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.236464:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.236481:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.236484:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.236490:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.236513:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.236523:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.236540:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.236566:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789118122.236832:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789118122.236840:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.236848:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118122.236852:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.236861:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.236891:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.236900:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000598e082a/0xaa253ed19be216fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.236932:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118122.236934:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118122.236937:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789118122.237494:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.237513:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be21702 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.237523:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.237527:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.237541:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be21702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.237552:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be21702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.237572:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be21702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.237579:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be21702 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.237641:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789118122.238307:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.238315:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088914707/0xaa253ed19be21709 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.238325:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.238329:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.238333:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088914707/0xaa253ed19be21709 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.238344:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088914707/0xaa253ed19be21709 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.238352:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088914707/0xaa253ed19be21709 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.238358:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088914707/0xaa253ed19be21709 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.242564:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789118122.242583:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be21702 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.242598:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70de00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118122.242603:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be21702 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.242615:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be21702 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.242667:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be21702 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.242675:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eea0cc3f/0xaa253ed19be21702 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.242714:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118122.242718:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088914707/0xaa253ed19be21709 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.242724:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118122.242727:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088914707/0xaa253ed19be21709 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.242734:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088914707/0xaa253ed19be21709 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.242742:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088914707/0xaa253ed19be21709 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.242749:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.242751:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.242753:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118122.243796:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789118122.243809:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088914707/0xaa253ed19be21709 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789118122.249647:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.249666:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be21710 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.249685:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.249690:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.249696:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be21710 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.249713:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be21710 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.249722:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be21710 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.249729:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be21710 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.256461:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789118122.256905:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118122.256915:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be21710 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.256929:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118122.256935:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be21710 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.256965:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be21710 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.256994:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be21710 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.257003:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf5dc37/0xaa253ed19be21710 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.257030:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118122.257032:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118122.257034:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789118122.257761:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.257772:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020f25d6a/0xaa253ed19be21717 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.257795:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.257800:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.257807:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020f25d6a/0xaa253ed19be21717 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.257821:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020f25d6a/0xaa253ed19be21717 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.257832:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020f25d6a/0xaa253ed19be21717 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.257839:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020f25d6a/0xaa253ed19be21717 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.257852:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789118122.258715:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.258724:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83345b7/0xaa253ed19be2171e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.258734:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.258737:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.258742:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b83345b7/0xaa253ed19be2171e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.258753:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b83345b7/0xaa253ed19be2171e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.258772:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83345b7/0xaa253ed19be2171e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.258779:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b83345b7/0xaa253ed19be2171e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.258804:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789118122.260335:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.260350:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e5777fb/0xaa253ed19be21725 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.260364:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.260369:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.260375:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e5777fb/0xaa253ed19be21725 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.260388:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e5777fb/0xaa253ed19be21725 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.260398:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e5777fb/0xaa253ed19be21725 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.260405:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e5777fb/0xaa253ed19be21725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.260431:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789118122.263142:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789118122.263160:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020f25d6a/0xaa253ed19be21717 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263175:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db200 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118122.263181:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020f25d6a/0xaa253ed19be21717 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263193:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020f25d6a/0xaa253ed19be21717 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789118122.263206:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.263217:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2172c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263218:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020f25d6a/0xaa253ed19be21717 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.263239:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.263245:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.263252:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2172c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.263264:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2172c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.263273:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2172c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.263280:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2172c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.263289:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789118122.263316:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020f25d6a/0xaa253ed19be21717 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263345:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789118122.263349:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b83345b7/0xaa253ed19be2171e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263356:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118122.263370:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83345b7/0xaa253ed19be2171e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263379:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83345b7/0xaa253ed19be2171e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263390:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b83345b7/0xaa253ed19be2171e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263397:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b83345b7/0xaa253ed19be2171e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263411:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789118122.263416:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e5777fb/0xaa253ed19be21725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263422:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813da000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118122.263425:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e5777fb/0xaa253ed19be21725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263432:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e5777fb/0xaa253ed19be21725 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263441:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e5777fb/0xaa253ed19be21725 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263448:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e5777fb/0xaa253ed19be21725 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263469:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789118122.263472:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2172c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263478:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118122.263480:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2172c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263487:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2172c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263496:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2172c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.263535:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789118122.263831:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.263837:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21733 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.263845:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.263853:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.263858:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21733 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.263867:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21733 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263950:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2172c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.263966:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118122.263968:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118122.263970:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118122.264225:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21733 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.264231:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21733 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.264291:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789118122.265273:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.265283:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be2173a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.265295:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.265300:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.265306:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be2173a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.265319:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be2173a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.265327:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be2173a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.265345:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be2173a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.269265:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789118122.269280:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21733 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.269295:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dae00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118122.269300:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21733 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.269312:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21733 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.269333:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21733 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.269358:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21733 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.269484:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118122.269491:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be2173a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.269524:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813daa00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118122.269538:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be2173a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.269547:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be2173a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.269559:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be2173a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.269568:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.269570:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.269572:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118122.270515:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789118122.270526:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be2173a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.270814:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789118122.271712:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789118122.271721:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be21741 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.271737:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=774s v=(0 0) 00010000:00010000:2.0:1789118122.271741:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118122.271747:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be21741 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.271762:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be21741 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.271771:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be21741 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.271779:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be21741 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.271804:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789118122.272589:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789118122.272597:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be21748 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.272613:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=774s v=(0 0) 00010000:00010000:2.0:1789118122.272617:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118122.272622:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be21748 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.272634:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be21748 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.272643:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be21748 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.272650:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be21748 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.272671:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789118122.272716:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789118122.272725:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be21741 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.272734:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92c00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789118122.272739:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be21741 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.272750:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be21741 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.272767:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be21741 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.272775:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008936cda0/0xaa253ed19be21741 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.272790:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789118122.272799:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be21748 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.272805:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93800 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789118122.272808:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be21748 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.272816:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be21748 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.272825:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be21748 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.272829:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118122.272834:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a55ee79f/0xaa253ed19be21748 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.272845:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118122.272847:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118122.272849:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789118122.277090:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789118122.277105:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be2174f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.277122:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=774s v=(0 0) 00010000:00010000:2.0:1789118122.277127:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118122.277135:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be2174f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.277151:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be2174f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.277176:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be2174f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.277184:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be2174f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.277206:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789118122.277751:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118122.277760:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be2174f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.277770:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118122.277775:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be2174f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.277785:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be2174f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.277802:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be2174f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.277818:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce58800/0xaa253ed19be2174f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.277838:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.277840:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.277841:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789118122.278643:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.278654:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21756 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.278666:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.278670:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.278676:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21756 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.278700:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21756 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.278709:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21756 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.278717:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21756 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.278739:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789118122.279232:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118122.279238:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21756 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.279247:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813daa00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118122.279250:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21756 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.279259:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21756 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.279275:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21756 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.279283:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21756 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.279300:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.279302:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.279303:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789118122.282745:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.282763:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de805928/0xaa253ed19be2175d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.282780:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.282784:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.282790:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de805928/0xaa253ed19be2175d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.282805:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de805928/0xaa253ed19be2175d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.282815:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de805928/0xaa253ed19be2175d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.282836:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de805928/0xaa253ed19be2175d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.282856:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789118122.283103:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118122.283112:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de805928/0xaa253ed19be2175d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.283121:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dbe00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118122.283126:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de805928/0xaa253ed19be2175d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.283136:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de805928/0xaa253ed19be2175d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.283153:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de805928/0xaa253ed19be2175d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.283162:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de805928/0xaa253ed19be2175d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.283179:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.283181:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.283183:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789118122.283459:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.283467:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000070856a3/0xaa253ed19be21764 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.283475:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.283478:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.283482:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000070856a3/0xaa253ed19be21764 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.283492:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000070856a3/0xaa253ed19be21764 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.283512:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000070856a3/0xaa253ed19be21764 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.283519:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000070856a3/0xaa253ed19be21764 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.283540:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789118122.283691:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118122.283697:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000070856a3/0xaa253ed19be21764 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.283705:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813da800 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118122.283708:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000070856a3/0xaa253ed19be21764 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.283729:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000070856a3/0xaa253ed19be21764 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.283741:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000070856a3/0xaa253ed19be21764 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.283749:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000070856a3/0xaa253ed19be21764 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.283764:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.283766:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.283768:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789118122.284457:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.284466:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c253a89f/0xaa253ed19be2176b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.284482:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.284485:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.284490:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c253a89f/0xaa253ed19be2176b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.284514:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c253a89f/0xaa253ed19be2176b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.284523:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c253a89f/0xaa253ed19be2176b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.284532:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c253a89f/0xaa253ed19be2176b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.284595:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789118122.287625:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118122.287638:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c253a89f/0xaa253ed19be2176b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.287652:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dba00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118122.287657:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c253a89f/0xaa253ed19be2176b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.287668:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c253a89f/0xaa253ed19be2176b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.287690:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c253a89f/0xaa253ed19be2176b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.287710:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c253a89f/0xaa253ed19be2176b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.287730:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.287732:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.287733:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789118122.288633:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.288642:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5f74868/0xaa253ed19be21772 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.288657:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.288662:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.288667:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5f74868/0xaa253ed19be21772 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.288680:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5f74868/0xaa253ed19be21772 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.288699:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5f74868/0xaa253ed19be21772 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.288706:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5f74868/0xaa253ed19be21772 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.288730:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789118122.289050:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118122.289086:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5f74868/0xaa253ed19be21772 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.289094:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813da600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118122.289098:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5f74868/0xaa253ed19be21772 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.289106:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5f74868/0xaa253ed19be21772 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.289120:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5f74868/0xaa253ed19be21772 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.289127:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5f74868/0xaa253ed19be21772 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.289140:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.289142:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.289144:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789118122.289617:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.289625:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c162a5a1/0xaa253ed19be21779 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.289634:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.289637:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.289642:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c162a5a1/0xaa253ed19be21779 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.289653:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c162a5a1/0xaa253ed19be21779 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.289661:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c162a5a1/0xaa253ed19be21779 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.289668:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c162a5a1/0xaa253ed19be21779 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.289698:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789118122.290399:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.290407:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21780 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.290416:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.290420:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.290424:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21780 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.290435:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21780 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.290442:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21780 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.290450:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21780 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.290523:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789118122.290898:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.290905:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21787 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.290914:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.290924:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.290929:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21787 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.290939:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21787 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.290946:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21787 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.290954:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21787 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.290995:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789118122.291002:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c162a5a1/0xaa253ed19be21779 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.291011:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db800 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118122.291015:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c162a5a1/0xaa253ed19be21779 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.291023:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c162a5a1/0xaa253ed19be21779 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.291038:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c162a5a1/0xaa253ed19be21779 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.291045:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c162a5a1/0xaa253ed19be21779 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.291077:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789118122.291086:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21780 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.291092:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813daa00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118122.291095:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21780 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.291103:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21780 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.291112:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21780 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.291119:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6c3c90d/0xaa253ed19be21780 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.291131:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118122.291134:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21787 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.291140:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dae00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118122.291143:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21787 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.291150:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21787 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.291169:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21787 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.291178:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118122.291179:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118122.291181:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.293712:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118122.293879:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789118122.293892:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f7fa2a8/0xaa253ed19be21787 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789118122.295382:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789118122.295396:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2178e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.295412:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=774s v=(0 0) 00010000:00010000:1.0:1789118122.295417:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789118122.295424:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2178e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.295440:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2178e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.295456:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2178e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118122.295464:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2178e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.295809:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118122.295816:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2178e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.295824:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118122.295828:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2178e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.295837:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2178e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.295853:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2178e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.295872:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118122.295873:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118122.295875:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118122.296287:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789118122.296294:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9bbce8f/0xaa253ed19be2178e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789118122.297737:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118122.297746:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095df44b1/0xaa253ed19be21795 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.297761:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=774s v=(0 0) 00010000:00010000:3.0:1789118122.297775:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118122.297783:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095df44b1/0xaa253ed19be21795 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.297797:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095df44b1/0xaa253ed19be21795 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.297807:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095df44b1/0xaa253ed19be21795 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.297814:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095df44b1/0xaa253ed19be21795 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.300955:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118122.300971:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095df44b1/0xaa253ed19be21795 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.300996:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789118122.303050:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9ae00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118122.303069:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095df44b1/0xaa253ed19be21795 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.303080:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095df44b1/0xaa253ed19be21795 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.303102:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095df44b1/0xaa253ed19be21795 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.303109:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095df44b1/0xaa253ed19be21795 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.303132:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118122.303133:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789118122.303135:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118122.303137:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118122.303140:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a58705/0xaa253ed19be2179c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.303151:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=774s v=(0 0) 00010000:00010000:3.0:1789118122.303156:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118122.303162:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027a58705/0xaa253ed19be2179c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.303172:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027a58705/0xaa253ed19be2179c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.303180:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027a58705/0xaa253ed19be2179c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.303194:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027a58705/0xaa253ed19be2179c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.303207:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789118122.304378:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118122.304386:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027a58705/0xaa253ed19be2179c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.304396:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9b800 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118122.304400:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a58705/0xaa253ed19be2179c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.304409:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027a58705/0xaa253ed19be2179c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.304425:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027a58705/0xaa253ed19be2179c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.304433:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027a58705/0xaa253ed19be2179c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118122.304450:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.304452:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118122.304454:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118122.304843:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118122.304850:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074b81f2e/0xaa253ed19be217a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.304861:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=774s v=(0 0) 00010000:00010000:3.0:1789118122.304865:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118122.304870:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074b81f2e/0xaa253ed19be217a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.304881:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074b81f2e/0xaa253ed19be217a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.304890:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074b81f2e/0xaa253ed19be217a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.304899:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074b81f2e/0xaa253ed19be217a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118122.304923:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789118122.304991:0:24890:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00010000:00010000:2.0:1789118122.305085:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118122.305091:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074b81f2e/0xaa253ed19be217a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.305098:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9ba00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118122.305101:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074b81f2e/0xaa253ed19be217a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.305109:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074b81f2e/0xaa253ed19be217a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118122.305123:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:23402:x1876025593322880:12345-0@lo:5:osp-pre-0-0.0 Request processed in 145957us (146348us total) trans 0 rc 0/0 00010000:00010000:2.0:1789118122.305127:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074b81f2e/0xaa253ed19be217a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118122.305134:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074b81f2e/0xaa253ed19be217a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118122.305137:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789118122.305147:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118122.305149:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118122.305151:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118122.305439:0:23402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87d9f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23402:1876025593322880:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789118122.305457:0:23402:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:0.0:1789118122.305523:0:23402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a31a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23402:1876025593323008:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789118122.305565:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118122.305597:0:23402:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84b7b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789118122.305640:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593323008 00000100:00100000:3.0:1789118122.305647:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593323008 00000100:00100000:3.0:1789118122.305691:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789118122.305701:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:23402:x1876025593323008:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789118122.305735:0:24891:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:0.0:1789118122.313968:0:24887:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1789118122.314037:0:24887:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789118122.314258:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a30f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:23402:x1876025593323008:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8552us (8686us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789118122.314269:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789118122.315036:0:23402:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1789118122.315047:0:23402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a31a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23402:1876025593323008:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789118122.315098:0:23402:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000020:00000004:2.0:1789118122.666655:0:25310:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789118122.666861:0:25310:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789118123.045287:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789118123.573612:0:25360:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789118123.573847:0:25360:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789118124.069624:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118125.093243:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789118125.413428:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789118125.413464:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593323136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789118125.413536:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118125.413677:0:24893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593323136 00000100:00100000:3.0:1789118125.413685:0:24893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593323136 00000100:00100000:3.0:1789118125.413749:0:24893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789118125.413760:0:24893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593323136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789118125.413789:0:24893:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789118125.413833:0:24893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593323136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118125.413840:0:24893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789118125.413884:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593323136:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789118125.413934:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789118126.117668:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789118126.438085:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789118126.438110:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593323264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789118126.438174:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118126.438225:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593323264 00000100:00100000:1.0:1789118126.438232:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593323264 00000100:00100000:1.0:1789118126.438292:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789118126.438301:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf726940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593323264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789118126.438341:0:23382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789118126.438384:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf726940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593323264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118126.438391:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789118126.438462:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593323264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789118126.439313:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789118126.440044:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593323392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789118126.440217:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118126.440329:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593323392 00000100:00100000:2.0:1789118126.440337:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593323392 00000100:00100000:2.0:1789118126.440463:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789118126.440476:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593323392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789118126.440517:0:23383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789118126.440577:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593323392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118126.440584:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789118126.440663:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593323392:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789118127.143934:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789118127.406183:0:24138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1789118127.461641:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118127.461649:0:24392:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789118127.461654:0:24392:0:(import.c:65:import_set_state_nolock()) ffff962b90578800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789118127.461664:0:24392:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 774 00000100:00080000:3.0:1789118127.461670:0:24392:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789118127.461688:0:24392:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b90578800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118127.461717:0:24392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87f6a940 x1876025593323904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789118127.462225:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118127.462229:0:24392:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789118127.462231:0:24392:0:(import.c:65:import_set_state_nolock()) ffff962a86836000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789118127.462236:0:24392:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 774 00000100:00080000:3.0:1789118127.462238:0:24392:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789118127.462243:0:24392:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962a86836000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118127.462255:0:24392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87f68780 x1876025593324416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789118127.462298:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593323520:0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.462373:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118127.462427:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593324160:0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.462533:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118127.462566:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593324800:0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.462595:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118127.462627:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789118127.462634:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593323648:0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.462660:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118127.462805:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593324160 00000100:00100000:0.0:1789118127.462813:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593324160 00000100:00100000:0.0:1789118127.462856:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593323648 00000100:00100000:0.0:1789118127.462859:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593323648 00000100:00100000:0.0:1789118127.462879:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789118127.462953:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593324160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118127.463012:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593324160:12345-0@lo:400:kworker.0 Request processed in 62us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118127.463020:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789118127.463044:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789118127.463090:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593323648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118127.463126:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593323648:12345-0@lo:400:kworker.0 Request processed in 76us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118127.463133:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789118127.463292:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593324288:0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.463328:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118127.463411:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593324160:0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.463436:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593323648:0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.463527:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593323776:0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.463568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118127.463978:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593324544:0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.464004:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118127.464025:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789118127.464031:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593324032:0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.464075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118127.464095:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593324672:0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.464119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118127.464149:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593324800 00000100:00100000:3.0:1789118127.464155:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593324800 00000100:00100000:3.0:1789118127.464196:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593324544 00000100:00100000:3.0:1789118127.464199:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593324544 00000100:00100000:3.0:1789118127.464211:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593324032 00000100:00100000:3.0:1789118127.464213:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593324032 00000100:00100000:3.0:1789118127.464222:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593324672 00000100:00100000:3.0:1789118127.464224:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593324672 00000100:00100000:3.0:1789118127.464240:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789118127.464246:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593324800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.464289:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593324800:12345-0@lo:400:kworker.0 Request processed in 43us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118127.464295:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789118127.464314:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789118127.464320:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf775a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593324544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.464356:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf775a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593324544:12345-0@lo:400:kworker.0 Request processed in 36us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118127.464361:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789118127.464372:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789118127.464386:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593324032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.464429:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593324032:12345-0@lo:400:kworker.0 Request processed in 44us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118127.464435:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789118127.464542:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593324288 00000100:00100000:0.0:1789118127.464547:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593324288 00000100:00100000:0.0:1789118127.464581:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593323776 00000100:00100000:0.0:1789118127.464583:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593323776 00000100:00100000:0.0:1789118127.464600:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789118127.464606:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593324288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118127.464642:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593324288:12345-0@lo:400:kworker.0 Request processed in 37us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118127.464649:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789118127.464664:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789118127.464671:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593323776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118127.464700:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593323776:12345-0@lo:400:kworker.0 Request processed in 30us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118127.464706:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789118127.464877:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789118127.464960:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593324672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.464994:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593324672:12345-0@lo:400:kworker.0 Request processed in 38us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118127.465000:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789118127.465093:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a87f68f00 x1876025593324032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118127.465108:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593324032:0@lo:400:kworker.0 00010000:00080000:3.0:1789118127.465120:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a87f68000 x1876025593324672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118127.465128:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593324672:0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.465138:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593323776:0@lo:400:kworker.0 00010000:00080000:3.0:1789118127.465147:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a87f6b0c0 x1876025593324544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118127.465155:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593324544:0@lo:400:kworker.0 00000100:00100000:3.0:1789118127.465193:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593324288:0@lo:400:kworker.0 00010000:00080000:3.0:1789118127.465204:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a87f6a1c0 x1876025593324800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118127.465211:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593324800:0@lo:400:kworker.0 00000100:00100000:0.0:1789118127.465725:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593323520 00000100:00100000:0.0:1789118127.465731:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593323520 00000100:00100000:0.0:1789118127.465777:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789118127.465784:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:3644:x1876025593323520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118127.465830:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:3644:x1876025593323520:12345-0@lo:400:kworker.0 Request processed in 47us (3458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118127.465837:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789118127.465875:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593323904:0@lo:8:kworker.0 00000100:00100000:0.0:1789118127.465918:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118127.465941:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593324416:0@lo:8:kworker.0 00000100:00100000:0.0:1789118127.465963:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118127.466028:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593323904 00000100:00100000:0.0:1789118127.466031:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593323904 00000100:00100000:0.0:1789118127.466076:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593324416 00000100:00100000:0.0:1789118127.466079:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593324416 00000100:00100000:0.0:1789118127.466090:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789118127.466095:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593323904:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789118127.466114:0:24890:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789118127.466147:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593323904:12345-0@lo:8:kworker.0 Request processed in 50us (229us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789118127.466153:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789118127.466166:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789118127.466169:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593324416:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789118127.466179:0:24890:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789118127.466201:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593324416:12345-0@lo:8:kworker.0 Request processed in 30us (238us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789118127.466208:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789118127.466235:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b90578800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789118127.466240:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789118127.466243:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593323904:0@lo:8:kworker.0 00000100:00080000:0.0:1789118127.466251:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a86836000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789118127.466254:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789118127.466257:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593324416:0@lo:8:kworker.0 00000100:00080000:1.0:1789118127.466356:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789118127.466362:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789118127.466363:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789118127.466473:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a33840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593324928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789118127.466503:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118127.466551:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593323520:0@lo:400:kworker.0 00000100:00100000:0.0:1789118127.466864:0:24893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593324928 00000100:00100000:0.0:1789118127.466869:0:24893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593324928 00000100:00100000:0.0:1789118127.467027:0:24893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789118127.467035:0:24893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593324928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789118127.467096:0:24893:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789118127.467148:0:24893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593324928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118127.467156:0:24893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789118127.471267:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a33840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593324928:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789118128.166371:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118129.190418:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789118129.830038:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789118130.226006:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118130.533390:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf776940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593325056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789118130.533467:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118130.533569:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593325056 00000100:00100000:3.0:1789118130.533577:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593325056 00000100:00100000:3.0:1789118130.533638:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789118130.533648:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593325056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789118130.533678:0:24894:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789118130.533741:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593325056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118130.533749:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789118130.533809:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf776940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593325056:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789118130.534002:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789118131.237490:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118131.558299:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf776940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593325184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789118131.558400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118131.558503:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593325184 00000100:00100000:3.0:1789118131.558512:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593325184 00000100:00100000:3.0:1789118131.558575:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789118131.558585:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593325184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789118131.558620:0:24121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789118131.558669:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593325184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118131.558676:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789118131.558754:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf776940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593325184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789118131.564678:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a33840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593325312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789118131.564760:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118131.564878:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593325312 00000100:00100000:0.0:1789118131.564886:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593325312 00000100:00100000:0.0:1789118131.564960:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789118131.564973:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593325312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789118131.565015:0:23382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789118131.565098:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593325312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118131.565105:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789118131.565165:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a33840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593325312:0@lo:41:osp-pre-1-0.0 00000020:01000004:2.0:1789118131.629266:0:25705:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789118131.629270:0:25705:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789118131.629277:0:25705:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789118131.629399:0:25705:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff962a89067000 00000020:01000004:2.0:1789118131.629418:0:25705:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789118131.629434:0:25705:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789118131.629450:0:25705:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff962bbcdd9a48) 00000020:00000080:2.0:1789118131.629469:0:25705:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789118131.761122:0:25705:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789118131.764199:0:25705:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789118131.766658:0:25705:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789118131.773031:0:25705:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789118131.775045:0:25705:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789118131.776394:0:25705:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789118131.777436:0:25705:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1789118131.785646:0:25705:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789118131.787531:0:25705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789118131.787549:0:25705:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789118131.787569:0:25705:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa253ed19be217b1 00000020:01000004:2.0:1789118131.787577:0:25705:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789118131.787602:0:25705:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789118131.787606:0:25705:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789118131.787613:0:25705:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789118131.787647:0:25705:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789118131.787651:0:25705:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789118131.808725:0:25705:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789118131.808767:0:25705:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.130@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789118131.808772:0:25705:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789118131.808774:0:25705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789118131.808775:0:25705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789118131.808781:0:25705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789118131.808782:0:25705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789118131.808784:0:25705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789118131.808785:0:25705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789118131.808787:0:25705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789118131.808788:0:25705:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789118131.808792:0:25705:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789118131.808794:0:25705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789118131.808795:0:25705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789118131.808796:0:25705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789118131.808797:0:25705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789118131.808852:0:25705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789118131.808854:0:25705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789118131.808855:0:25705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789118131.808856:0:25705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789118131.808857:0:25705:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789118131.808894:0:25705:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789118131.809388:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a33840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593325440:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789118131.809485:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118131.809573:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84b7b180 going to sleep for 11 seconds 00000100:00100000:3.0:1789118131.810385:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593325440 00000100:00100000:3.0:1789118131.810397:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593325440 00000100:00100000:0.0:1789118131.810522:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789118131.810533:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:25705:x1876025593325440:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789118131.810576:0:23372:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789118131.810579:0:23372:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789118131.810584:0:23372:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789118131.811035:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:25705:x1876025593325440:12345-0@lo:253:mount.lustre.0 Request processed in 502us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118131.811044:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789118131.811348:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a33840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593325440:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789118131.811364:0:25705:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789118131.811368:0:25705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789118131.811370:0:25705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789118131.811371:0:25705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789118131.811372:0:25705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789118131.811373:0:25705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789118131.811375:0:25705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789118131.811376:0:25705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789118131.811379:0:25705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789118131.811380:0:25705:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789118131.811406:0:25705:0:(tgt_mount.c:101:server_register_mount()) register mount ffff962a89067000 from lustre-OST0001 10000000:01000000:2.0:1789118131.811468:0:25705:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789118131.811471:0:25705:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789118131.811481:0:25705:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff962b88029a48 local copy 00010000:00010000:2.0:1789118131.811491:0:25705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be213f2 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118131.811625:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593325568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789118131.811675:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118131.811722:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bad82a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789118131.811787:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593325568 00000100:00100000:3.0:1789118131.811793:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593325568 00000100:00100000:3.0:1789118131.811970:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789118131.811980:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:25705:x1876025593325568:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789118131.812087:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:25705:x1876025593325568:12345-0@lo:501:mount.lustre.0 Request processed in 108us (411us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789118131.812094:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789118131.812159:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593325568:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789118131.812173:0:25705:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789118131.812193:0:25705:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789118131.812208:0:25705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be213f2 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.812216:0:25705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a88d9b200/0xaa253ed19be213eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be213f2 expref: -99 pid: 23356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789118131.812246:0:25705:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff962a89067000 10000000:01000000:2.0:1789118131.812251:0:25705:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789118131.812256:0:25705:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789118131.812258:0:25705:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789118131.812263:0:25705:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789118131.812266:0:25705:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789118131.812292:0:25705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92200/0xaa253ed19be217b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.812301:0:25705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d92200/0xaa253ed19be217b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.812333:0:25705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d92200/0xaa253ed19be217b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118131.812350:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593325696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789118131.812376:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118131.817337:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bad82a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789118131.817600:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593325696 00000100:00100000:1.0:1789118131.817609:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593325696 00000100:00100000:1.0:1789118131.817670:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789118131.817679:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:25705:x1876025593325696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789118131.817696:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118131.817721:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813dbe00/0xaa253ed19be217bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be217b8 expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.817753:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813dbe00/0xaa253ed19be217bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be217b8 expref: 22 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.817765:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813dbe00/0xaa253ed19be217bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be217b8 expref: 22 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.817774:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dbe00, rc 0) 00000100:00100000:1.0:1789118131.817860:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:25705:x1876025593325696:12345-0@lo:101:mount.lustre.0 Request processed in 182us (5482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118131.817867:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789118131.818131:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593325696:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789118131.818154:0:25705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d92200/0xaa253ed19be217b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be217bf expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.818165:0:25705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d92200/0xaa253ed19be217b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be217bf expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789118131.822983:0:25705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1789118131.824241:0:25705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789118131.830013:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789118131.830379:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1789118131.830400:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1789118131.830414:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1789118131.830488:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1789118131.830517:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1789118131.830530:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1789118131.830543:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1789118131.830555:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1789118131.830582:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1789118131.830587:0:25705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1789118131.830731:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593325824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789118131.831090:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118131.831159:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789118131.831331:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593325824 00000100:00100000:0.0:1789118131.831340:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593325824 00000100:00100000:0.0:1789118131.831392:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789118131.831401:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:25705:x1876025593325824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789118131.831568:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:25705:x1876025593325824:12345-0@lo:501:mount.lustre.0 Request processed in 167us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118131.831584:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789118131.831904:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593325824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789118131.831949:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593325952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789118131.831994:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118131.832026:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789118131.832085:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593325952 00000100:00100000:0.0:1789118131.832090:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593325952 00000100:00100000:0.0:1789118131.832117:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789118131.832124:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:25705:x1876025593325952:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789118131.832961:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:25705:x1876025593325952:12345-0@lo:503:mount.lustre.0 Request processed in 835us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118131.832969:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789118131.836483:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593325952:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789118131.837342:0:25705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789118131.837444:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118131.837528:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118131.837576:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789118131.837707:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593326080 00000100:00100000:3.0:1789118131.837714:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593326080 00000100:00100000:3.0:1789118131.837760:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789118131.837770:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:25705:x1876025593326080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789118131.838404:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:25705:x1876025593326080:12345-0@lo:502:mount.lustre.0 Request processed in 633us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118131.838412:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789118131.838614:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789118131.838850:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789118131.838880:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1789118131.838896:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1789118131.838910:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1789118131.838924:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1789118131.838938:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1789118131.838950:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1789118131.838962:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1789118131.838975:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1789118131.839007:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a33840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789118131.839050:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118131.839113:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84b7bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789118131.839234:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593326208 00000100:00100000:1.0:1789118131.839240:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593326208 00000100:00100000:1.0:1789118131.839284:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789118131.839292:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:25705:x1876025593326208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118131.839396:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:25705:x1876025593326208:12345-0@lo:502:mount.lustre.0 Request processed in 104us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118131.839403:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789118131.839598:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a33840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789118131.839643:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1789118131.839652:0:25705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1789118131.842839:0:25709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789118131.842867:0:25709:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789118131.842875:0:25709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789118131.842877:0:25709:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789118131.842885:0:25709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789118131.842909:0:25709:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff962b8e9cb490) 00000020:00000080:1.0:1789118131.842957:0:25709:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789118131.842965:0:25709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789118131.843049:0:25709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962a89067000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789118131.843130:0:25709:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789118131.843139:0:25709:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa253ed19be217cd 00010000:00010000:0.0:1789118131.852604:0:25709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1789118131.853105:0:25709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1789118131.854939:0:25709:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:3.0:1789118131.865749:0:25709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789118131.865767:0:25709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789118131.865776:0:25709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118131.865778:0:25709:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789118131.865782:0:25709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789118131.865786:0:25709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118131.865788:0:25709:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789118131.865791:0:25709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789118131.865793:0:25709:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789118131.865795:0:25709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789118131.865797:0:25709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118131.865809:0:25709:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789118131.865813:0:25709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789118131.865815:0:25709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118131.865825:0:25709:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789118131.865830:0:25709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789118131.865863:0:25709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789118131.865867:0:25709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789118131.865869:0:25709:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789118131.865872:0:25709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1789118131.866566:0:25705:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789118131.866602:0:25705:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789118131.866624:0:25705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92200/0xaa253ed19be217b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be217bf expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.866636:0:25705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d92200/0xaa253ed19be217b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be217bf expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789118131.866644:0:25705:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962a89067000 from 1 10000000:01000000:2.0:1789118131.866647:0:25705:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789118131.866683:0:25705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.866690:0:25705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.866714:0:25705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118131.866739:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789118131.866816:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118131.866858:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bad82a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789118131.867231:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593326336 00000100:00100000:0.0:1789118131.867239:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593326336 00000100:00100000:0.0:1789118131.867291:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789118131.867301:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:25705:x1876025593326336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789118131.867316:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789118131.867339:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b8ee64400/0xaa253ed19be217db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be217d4 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118131.867363:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b8ee64400/0xaa253ed19be217db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be217d4 expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118131.867374:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b8ee64400/0xaa253ed19be217db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be217d4 expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118131.867383:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b8ee64400, rc 0) 00000100:00100000:0.0:1789118131.867442:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:25705:x1876025593326336:12345-0@lo:101:mount.lustre.0 Request processed in 142us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118131.867450:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789118131.867651:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789118131.867665:0:25705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be217db expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.867674:0:25705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be217db expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789118131.868983:0:25705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000040:00080000:2.0:1789118131.869390:0:25705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789118131.870497:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789118131.870528:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1789118131.870543:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1789118131.870557:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1789118131.870570:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1789118131.870583:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1789118131.870597:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1789118131.870612:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 144 off9680 00000040:00080000:2.0:1789118131.870625:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9904 00000040:00080000:2.0:1789118131.870638:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10128 00000040:00080000:2.0:1789118131.870651:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 144 off10272 00000040:00080000:2.0:1789118131.871049:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10496 00000040:00080000:2.0:1789118131.871080:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 224 off10720 00000040:00080000:2.0:1789118131.871094:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10848 00000040:00080000:2.0:1789118131.871115:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off11072 00000040:00080000:2.0:1789118131.871143:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11296 00000040:00080000:2.0:1789118131.871156:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 128 off11424 00000040:00080000:2.0:1789118131.871173:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11648 00000040:00080000:2.0:1789118131.871178:0:25705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 18 count 19 00000100:00100000:2.0:1789118131.871356:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789118131.871488:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118131.871533:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bad82a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789118131.872838:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593326464 00000100:00100000:0.0:1789118131.872850:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593326464 00000100:00100000:0.0:1789118131.872914:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789118131.872924:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:25705:x1876025593326464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789118131.873105:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:25705:x1876025593326464:12345-0@lo:501:mount.lustre.0 Request processed in 183us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118131.873112:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789118131.873123:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789118131.873168:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326592:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789118131.873295:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118131.873342:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bad82a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789118131.875876:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593326592 00000100:00100000:0.0:1789118131.875887:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593326592 00000100:00100000:0.0:1789118131.875960:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789118131.875970:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:25705:x1876025593326592:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789118131.876206:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:25705:x1876025593326592:12345-0@lo:503:mount.lustre.0 Request processed in 237us (2910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118131.876215:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789118131.876252:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326592:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789118131.876745:0:25705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789118131.876861:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789118131.877260:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118131.877299:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593326720 00000100:00100000:2.0:1789118131.877300:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40480 going to sleep for 11 seconds 00000100:00100000:0.0:1789118131.877306:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593326720 00000100:00100000:0.0:1789118131.877356:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789118131.877365:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:25705:x1876025593326720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789118131.877492:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:25705:x1876025593326720:12345-0@lo:502:mount.lustre.0 Request processed in 128us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118131.877500:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789118131.877621:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789118131.877881:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789118131.877909:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789118131.877925:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789118131.877938:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789118131.877949:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789118131.877961:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789118131.877974:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789118131.877988:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 144 off9680 00000040:00080000:3.0:1789118131.877999:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9904 00000040:00080000:3.0:1789118131.878010:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10128 00000040:00080000:3.0:1789118131.878021:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 144 off10272 00000040:00080000:3.0:1789118131.878033:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10496 00000040:00080000:3.0:1789118131.878046:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 224 off10720 00000040:00080000:3.0:1789118131.878094:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10848 00000040:00080000:3.0:1789118131.878111:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off11072 00000040:00080000:3.0:1789118131.878125:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11296 00000040:00080000:3.0:1789118131.878138:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 128 off11424 00000100:00100000:3.0:1789118131.878168:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789118131.878212:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118131.878233:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf612600 going to sleep for 11 seconds 00000100:00100000:0.0:1789118131.878419:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593326848 00000100:00100000:0.0:1789118131.878426:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593326848 00000100:00100000:0.0:1789118131.878456:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789118131.878463:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:25705:x1876025593326848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789118131.878547:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:25705:x1876025593326848:12345-0@lo:502:mount.lustre.0 Request processed in 83us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118131.878553:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789118131.878681:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789118131.878724:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11648 00000040:00080000:3.0:1789118131.878731:0:25705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:0.0:1789118131.880734:0:25713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789118131.880828:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118131.880832:0:25713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789118131.880841:0:25713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962a89067000 00000020:00000080:0.0:1789118131.880984:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789118131.880995:0:25713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118131.880998:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118131.881000:0:25713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789118131.881002:0:25713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789118131.881018:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118131.881020:0:25713:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789118131.881024:0:25713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff962a89067000 00000020:00000080:0.0:1789118131.881026:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789118131.881446:0:25713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118131.881451:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118131.881453:0:25713:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789118131.881455:0:25713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789118131.881458:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118131.881459:0:25713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789118131.881463:0:25713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a89067000 00000020:00000080:0.0:1789118131.881466:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789118131.884652:0:25713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118131.884663:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118131.884665:0:25713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789118131.884668:0:25713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789118131.884672:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118131.884673:0:25713:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789118131.884678:0:25713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a89067000 00000020:00000080:0.0:1789118131.884680:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789118131.885304:0:25713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118131.885313:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118131.885315:0:25713:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789118131.885329:0:25713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789118131.885333:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118131.885334:0:25713:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789118131.885338:0:25713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a89067000 00000020:00000080:0.0:1789118131.885342:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789118131.885410:0:25713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118131.885414:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118131.885415:0:25713:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789118131.885417:0:25713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789118131.885420:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118131.885426:0:25713:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789118131.885431:0:25713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff962a89067000 00000020:00000080:0.0:1789118131.885433:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789118131.888120:0:25713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789118131.888135:0:25713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789118131.888138:0:25713:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789118131.888142:0:25713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 19 count 19 00000020:01000000:3.0:1789118131.889704:0:25705:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:3.0:1789118131.889756:0:25705:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789118131.891209:0:25705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be217db expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118131.891226:0:25705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be217db expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118131.891293:0:25705:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789118131.891296:0:25705:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff962a89067000 10000000:01000000:3.0:1789118131.891300:0:25705:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff962a89067000 10000000:01000000:3.0:1789118131.891304:0:25705:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789118131.891309:0:25705:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff962a89067000 from 1 10000000:01000000:3.0:1789118131.891312:0:25705:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789118131.891365:0:25705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be217e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118131.891375:0:25705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be217e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118131.891386:0:25705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be217e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118131.891412:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326976:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789118131.891704:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118131.891768:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a86fe9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789118131.894134:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593326976 00000100:00100000:1.0:1789118131.894147:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593326976 00000100:00100000:1.0:1789118131.894200:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789118131.894210:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:25705:x1876025593326976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789118131.894227:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118131.894244:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813da800/0xaa253ed19be217e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be217e2 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.894271:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813da800/0xaa253ed19be217e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be217e2 expref: 24 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.894281:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813da800/0xaa253ed19be217e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be217e2 expref: 24 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.894291:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813da800, rc 0) 00000100:00100000:1.0:1789118131.894386:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:25705:x1876025593326976:12345-0@lo:101:mount.lustre.0 Request processed in 178us (2684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118131.894393:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789118131.894581:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593326976:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789118131.894603:0:25705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be217e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be217e9 expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118131.894613:0:25705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be217e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be217e9 expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789118131.911593:0:25705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1789118131.911995:0:25705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789118131.912268:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789118131.912291:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1789118131.912307:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1789118131.912331:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1789118131.912345:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1789118131.912356:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1789118131.912366:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1789118131.912378:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1789118131.912390:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789118131.912402:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1789118131.912414:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1789118131.914941:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1789118131.914981:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1789118131.914996:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1789118131.915013:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1789118131.915024:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1789118131.915037:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1789118131.915049:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1789118131.915206:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1789118131.915223:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1789118131.915238:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1789118131.915252:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1789118131.915263:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1789118131.915276:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1789118131.915301:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1789118131.915316:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1789118131.915346:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1789118131.915361:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1789118131.915375:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1789118131.915390:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1789118131.915403:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1789118131.915418:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1789118131.915447:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1789118131.915463:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1789118131.915477:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1789118131.915491:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1789118131.915506:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1789118131.915519:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1789118131.915532:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1789118131.915546:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1789118131.915560:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1789118131.915572:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1789118131.915585:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1789118131.915598:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1789118131.915634:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1789118131.915650:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1789118131.915665:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1789118131.915677:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1789118131.919011:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1789118131.919930:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1789118131.919970:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1789118131.919977:0:25705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1789118131.920725:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a33840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593327104:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789118131.921938:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118131.921978:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bae8f4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789118131.922481:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593327104 00000100:00100000:1.0:1789118131.922490:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593327104 00000100:00100000:1.0:1789118131.922538:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789118131.922554:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:25705:x1876025593327104:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789118131.922713:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:25705:x1876025593327104:12345-0@lo:501:mount.lustre.0 Request processed in 160us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118131.922722:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789118131.922776:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a33840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593327104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789118131.922838:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593327232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789118131.922885:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118131.922907:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789118131.922922:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593327232 00000100:00100000:1.0:1789118131.922926:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593327232 00000100:00100000:1.0:1789118131.922950:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789118131.922956:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:25705:x1876025593327232:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789118131.923034:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:25705:x1876025593327232:12345-0@lo:503:mount.lustre.0 Request processed in 78us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118131.923040:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789118131.923106:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593327232:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789118131.923494:0:25705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789118131.923578:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593327360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118131.923613:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118131.923629:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789118131.923646:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593327360 00000100:00100000:1.0:1789118131.923650:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593327360 00000100:00100000:1.0:1789118131.923673:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789118131.923679:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:25705:x1876025593327360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118131.923751:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:25705:x1876025593327360:12345-0@lo:502:mount.lustre.0 Request processed in 71us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118131.923764:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789118131.923802:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593327360:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789118131.923977:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789118131.924013:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789118131.924029:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789118131.924042:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789118131.924080:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789118131.924105:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789118131.924118:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789118131.924131:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789118131.924143:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789118131.924155:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789118131.924178:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789118131.924194:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789118131.924207:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789118131.924220:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789118131.924233:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789118131.924247:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789118131.924259:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789118131.924269:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789118131.924280:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789118131.924292:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789118131.924306:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789118131.924332:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789118131.924346:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789118131.924360:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789118131.924372:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1789118131.924386:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1789118131.924412:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1789118131.924426:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1789118131.924447:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1789118131.924459:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1789118131.924471:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1789118131.924483:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1789118131.924496:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1789118131.924508:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1789118131.924521:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1789118131.924534:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1789118131.924546:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789118131.924557:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789118131.924569:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789118131.924581:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789118131.924593:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789118131.924606:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789118131.924631:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789118131.924647:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789118131.924661:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789118131.924672:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789118131.924684:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789118131.924696:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789118131.924749:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593327488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118131.924813:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118131.924839:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789118131.924865:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593327488 00000100:00100000:1.0:1789118131.924871:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593327488 00000100:00100000:1.0:1789118131.924913:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789118131.924921:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:25705:x1876025593327488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118131.925010:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:25705:x1876025593327488:12345-0@lo:502:mount.lustre.0 Request processed in 89us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118131.925017:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789118131.925101:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593327488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789118131.925244:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1789118131.929045:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1789118131.929139:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593327616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789118131.931083:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118131.931143:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789118131.931237:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593327616 00000100:00100000:2.0:1789118131.931246:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593327616 00000100:00100000:2.0:1789118131.931305:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789118131.931315:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:25705:x1876025593327616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789118131.931505:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:25705:x1876025593327616:12345-0@lo:502:mount.lustre.0 Request processed in 191us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118131.931513:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789118131.931680:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593327616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789118131.931774:0:25705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1789118131.931788:0:25705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789118131.939875:0:25719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789118131.939892:0:25719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff962bbfac9a48) 00000020:00000080:3.0:1789118131.940039:0:25719:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789118131.940160:0:25719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962a89067000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789118131.940165:0:25719:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962a89067000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789118131.940167:0:25719:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962a89067000 3 00010000:00080000:3.0:1789118131.940280:0:25719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962a87d66800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.130@tcp at head 00010000:00010000:3.0:1789118131.949346:0:25719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789118131.949586:0:25719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789118131.949638:0:25719:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789118131.949651:0:25719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xaa253ed19be217f7 00000100:00080000:3.0:1789118131.949661:0:25719:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789118131.949668:0:25719:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff962a87d66800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118131.949702:0:25719:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf7743c0 x1876025593327744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789118131.949731:0:25719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789118131.949792:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118131.949796:0:24392:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789118131.949798:0:24392:0:(import.c:65:import_set_state_nolock()) ffff962b90578800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789118131.949803:0:24392:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 779 00000100:00080000:3.0:1789118131.949806:0:24392:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789118131.949809:0:24392:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b90578800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118131.949821:0:24392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bbf7770c0 x1876025593328128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789118131.949846:0:24392:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118131.949855:0:24392:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789118131.949857:0:24392:0:(import.c:65:import_set_state_nolock()) ffff962a86836000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789118131.949860:0:24392:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 779 00000100:00080000:3.0:1789118131.949862:0:24392:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789118131.949866:0:24392:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962a86836000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118131.949877:0:24392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962a87fa8000 x1876025593328640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789118131.949966:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf777c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593327872:0@lo:400:kworker.0 00000100:00100000:3.0:1789118131.950042:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118131.950086:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593327744:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789118131.950120:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593328512:0@lo:400:kworker.0 00000100:00100000:0.0:1789118131.950135:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118131.950157:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118131.950172:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593328128:0@lo:8:kworker.0 00000100:00100000:3.0:1789118131.950186:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789118131.950194:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593328384:0@lo:400:kworker.0 00000100:00100000:0.0:1789118131.950217:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118131.950226:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118131.950242:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593328640:0@lo:8:kworker.0 00000100:00100000:3.0:1789118131.950252:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593329024:0@lo:400:kworker.0 00000100:00100000:0.0:1789118131.950273:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118131.950284:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118131.950338:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593328000:0@lo:400:kworker.0 00000100:00100000:3.0:1789118131.950369:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118131.950381:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593328768:0@lo:400:kworker.0 00000100:00100000:3.0:1789118131.950402:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118131.950428:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789118131.950434:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf776940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593328256:0@lo:400:kworker.0 00000100:00100000:3.0:1789118131.950470:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118131.950481:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593328896:0@lo:400:kworker.0 00000100:00100000:0.0:1789118131.950514:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593327744 00000100:00100000:3.0:1789118131.950518:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118131.950522:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593327744 00000100:00100000:3.0:1789118131.950549:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593327872 00000100:00100000:0.0:1789118131.950550:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593329024 00000100:00100000:3.0:1789118131.950555:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593327872 00000100:00100000:0.0:1789118131.950556:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593329024 00000100:00100000:0.0:1789118131.950598:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593328768 00000100:00100000:0.0:1789118131.950601:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593328768 00000100:00100000:0.0:1789118131.950612:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593328256 00000100:00100000:0.0:1789118131.950614:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593328256 00000100:00100000:0.0:1789118131.950622:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593328896 00000100:00100000:0.0:1789118131.950624:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593328896 00000100:00100000:0.0:1789118131.950638:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789118131.951534:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593328384 00000100:00100000:3.0:1789118131.951542:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593328384 00000100:00100000:3.0:1789118131.951561:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789118131.951570:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593327872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118131.951651:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593327872:12345-0@lo:400:kworker.0 Request processed in 84us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118131.951659:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789118131.951677:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789118131.951683:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593328384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118131.951718:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593328384:12345-0@lo:400:kworker.0 Request processed in 36us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118131.951725:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789118131.951760:0:23379:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789118131.951768:0:23379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789118131.951788:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593328512 00000100:00100000:3.0:1789118131.951792:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593328512 00000100:00100000:3.0:1789118131.951898:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593328128 00000100:00100000:3.0:1789118131.951902:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593328128 00000100:00100000:3.0:1789118131.952014:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593328640 00000100:00100000:3.0:1789118131.952019:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593328640 00000100:00100000:3.0:1789118131.952034:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593328000 00000100:00100000:3.0:1789118131.952037:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593328000 00000100:00100000:3.0:1789118131.952081:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789118131.952089:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593328512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118131.952128:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593328512:12345-0@lo:400:kworker.0 Request processed in 40us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118131.952278:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789118131.952292:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789118131.952298:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593328000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118131.952354:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593328000:12345-0@lo:400:kworker.0 Request processed in 55us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118131.952362:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789118131.952375:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789118131.952379:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593328128:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789118131.952435:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593328128:12345-0@lo:8:kworker.0 Request processed in 54us (2219us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789118131.952441:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789118131.952453:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789118131.952456:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ed7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593328640:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789118131.952486:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ed7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593328640:12345-0@lo:8:kworker.0 Request processed in 29us (2214us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789118131.952490:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789118131.952521:0:23378:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789118131.952530:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789118131.952534:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876025593327744:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789118131.952550:0:23378:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 784 last 0 00000020:00000080:3.0:1789118131.952585:0:23378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xaa253ed19be217fe 00000004:00100000:3.0:1789118131.952600:0:23378:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789118131.952634:0:23378:0:(import.c:65:import_set_state_nolock()) ffff962a87d61000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789118131.952672:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876025593327744:12345-0@lo:38:llog_process_th.0 Request processed in 135us (2538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118131.952689:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789118131.952703:0:23378:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789118131.952710:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789118131.952716:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593328768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118131.952747:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593328768:12345-0@lo:400:kworker.0 Request processed in 32us (2344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118131.952753:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789118131.952765:0:23378:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789118131.952770:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789118131.952777:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593328256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118131.955431:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593329024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118131.955504:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876025593329024:12345-0@lo:400:kworker.0 Request processed in 4858us (5220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118131.955514:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789118131.955544:0:23377:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789118131.955555:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789118131.955563:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593328896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118131.955595:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593328896:12345-0@lo:400:kworker.0 Request processed in 33us (5079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118131.955600:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789118131.955624:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789118131.955630:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789118131.955642:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789118131.958308:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593328384:0@lo:400:kworker.0 00010000:00080000:0.0:1789118131.958347:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a87f6a940 x1876025593329024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118131.958359:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876025593329024:0@lo:400:kworker.0 00000100:00100000:0.0:1789118131.958373:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf777c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593327872:0@lo:400:kworker.0 00000100:00100000:0.0:1789118131.958385:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593328512:0@lo:400:kworker.0 00000100:00100000:3.0:1789118131.958513:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593328256:12345-0@lo:400:kworker.0 Request processed in 2347us (4654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118131.958523:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789118131.958576:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf7743c0 x1876025593327744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789118141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118131.958585:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789118131.958594:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1789118131.958603:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789118131.958608:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789118131.958612:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a87d66800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789118131.958620:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876025593327744:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789118131.958634:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789118131.958638:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b90578800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789118131.958641:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789118131.958644:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593328128:0@lo:8:kworker.0 00000100:00100000:3.0:1789118131.958668:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789118131.958672:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a86836000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789118131.958675:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789118131.958678:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593328640:0@lo:8:kworker.0 00010000:00080000:3.0:1789118131.958712:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bbf776940 x1876025593328256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118131.958723:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf776940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593328256:0@lo:400:kworker.0 00010000:00080000:3.0:1789118131.959419:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a87f68780 x1876025593328896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118131.959430:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593328896:0@lo:400:kworker.0 00000100:00100000:3.0:1789118131.959447:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593328000:0@lo:400:kworker.0 00010000:00080000:3.0:1789118131.959457:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962a87fabc00 x1876025593328768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118131.959465:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593328768:0@lo:400:kworker.0 00000020:01000004:0.0:1789118131.964707:0:25719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789118131.964726:0:25719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff962b8ee0ced8) 00000020:00000080:0.0:1789118131.964762:0:25719:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1789118131.965121:0:25719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff962a89067000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789118131.965126:0:25719:0:(tgt_mount.c:187:server_put_mount()) put mount ffff962a89067000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789118131.965129:0:25719:0:(obd_mount.c:710:lustre_put_lsi()) put ffff962a89067000 3 00010000:00080000:0.0:1789118131.965164:0:25719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff962bc0da9800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.130@tcp at head 00010000:00010000:3.0:1789118131.968905:0:25719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1789118131.969904:0:25719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789118131.970434:0:25719:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789118131.970455:0:25719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xaa253ed19be2180c 00000100:00080000:3.0:1789118131.970472:0:25719:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789118131.970482:0:25719:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff962bc0da9800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118131.970548:0:25719:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a4f840 x1876025593329152/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789118131.970600:0:25719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789118131.973029:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876025593329152:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789118131.973123:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118131.973734:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593329152 00000100:00100000:3.0:1789118131.973744:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593329152 00000100:00100000:3.0:1789118131.973782:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789118131.973790:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876025593329152:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789118131.973834:0:23377:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 784 last 0 00000020:00000080:3.0:1789118131.973889:0:23377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xaa253ed19be21813 00000004:00100000:3.0:1789118131.973906:0:23377:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789118131.973953:0:23377:0:(import.c:65:import_set_state_nolock()) ffff962b9832b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789118131.974021:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876025593329152:12345-0@lo:38:llog_process_th.0 Request processed in 231us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118131.974029:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789118131.974572:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff962bc1a4f840 x1876025593329152/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789118141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118131.974584:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789118131.974592:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1789118131.974599:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789118131.974604:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789118131.974607:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962bc0da9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789118131.974613:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876025593329152:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789118131.976788:0:25719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1789118131.977012:0:25705:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789118131.977051:0:25705:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789118131.977088:0:25705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be217e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be217e9 expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.977103:0:25705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a88d9a200/0xaa253ed19be217e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be217e9 expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789118131.977160:0:25705:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789118131.977166:0:25705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789118131.977167:0:25705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789118131.977168:0:25705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789118131.977170:0:25705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789118131.977171:0:25705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789118131.977172:0:25705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789118131.977174:0:25705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789118131.977175:0:25705:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789118131.977179:0:25705:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789118131.977182:0:25705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789118131.977183:0:25705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789118131.977184:0:25705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789118131.977185:0:25705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789118131.977186:0:25705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789118131.977187:0:25705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789118131.977188:0:25705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789118131.977189:0:25705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789118131.977204:0:25705:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789118131.977230:0:25705:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789118131.977251:0:25705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593329280:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789118131.977333:0:25705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118131.977379:0:25705:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789118131.977990:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593329280 00000100:00100000:3.0:1789118131.977997:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593329280 00000100:00100000:1.0:1789118131.978353:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789118131.978364:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:25705:x1876025593329280:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789118131.978397:0:23370:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789118131.978411:0:23370:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789118131.982546:0:23370:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789118131.982599:0:23370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789118131.982985:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:25705:x1876025593329280:12345-0@lo:253:mount.lustre.0 Request processed in 4619us (5647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118131.982998:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789118131.983225:0:25705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:25705:1876025593329280:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789118131.983240:0:25705:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789118131.983244:0:25705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789118131.983245:0:25705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789118131.983246:0:25705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789118131.983248:0:25705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789118131.983249:0:25705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789118131.983250:0:25705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789118131.983251:0:25705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789118131.983260:0:25705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789118131.983261:0:25705:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789118131.983277:0:25705:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1789118131.988089:0:25705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 20000000:01000000:0.0:1789118131.988344:0:23393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789118131.988351:0:23393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789118131.988689:0:23393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.988713:0:23393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962bbf70d000/0xaa253ed19be216ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be216a7 expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.988722:0:23393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d92000/0xaa253ed19be216bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be216b5 expref: 23 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.988731:0:23393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.989004:0:23393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d92000/0xaa253ed19be216bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be216b5 expref: 23 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.989024:0:23393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962a87d92000/0xaa253ed19be216bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be216b5 expref: 23 pid: 23369 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118131.989041:0:23393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23393:1876025593329408:0@lo:104: 00000100:00100000:1.0:1789118131.989342:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789118131.989451:0:23393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962bbf70d000/0xaa253ed19be216ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be216a7 expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.989460:0:23393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962bbf70d000/0xaa253ed19be216ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be216a7 expref: 23 pid: 23372 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118131.989469:0:23393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf725a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23393:1876025593329536:0@lo:104: 00000100:00100000:1.0:1789118131.989511:0:23393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118131.989609:0:23361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593329408 00000100:00100000:0.0:1789118131.989616:0:23361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593329408 00000100:00100000:0.0:1789118131.989656:0:23361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593329536 00000100:00100000:0.0:1789118131.989659:0:23361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593329536 00000100:00100000:0.0:1789118131.989673:0:23361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789118131.989681:0:23361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf724780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+4:23393:x1876025593329408:12345-0@lo:104: 00010000:00010000:0.0:1789118131.989694:0:23361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be216bc expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118131.990156:0:23361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789118131.990165:0:23361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf724780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+4:23393:x1876025593329408:12345-0@lo:104: Request processed in 483us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118131.990172:0:23361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789118131.990275:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118131.990284:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be216bc expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.990292:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d200 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:2.0:1789118131.990296:0:23365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be216bc expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.990304:0:23365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be216bc expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789118131.990310:0:23365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be216bc expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789118131.990327:0:23365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1789118131.990334:0:23361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789118131.990344:0:23361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+3:23393:x1876025593329536:12345-0@lo:104: 00010000:00010000:0.0:1789118131.990353:0:23361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be216ae expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.990362:0:23365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be216bc expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.990370:0:23365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789118131.990399:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be216bc expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.990408:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbf70d200/0xaa253ed19be216b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be216bc expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118131.990408:0:23361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789118131.990419:0:23361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+3:23393:x1876025593329536:12345-0@lo:104: Request processed in 76us (906us total) trans 0 rc 0/0 00010000:00010000:2.0:1789118131.990425:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789118131.990429:0:23361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789118131.990431:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be216ae expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.990449:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9a400 already unused, calling callback (ffffffffc13d9c20) 00010000:00010000:0.0:1789118131.990450:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789118131.990453:0:23365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be216ae expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.990462:0:23365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be216ae expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789118131.990468:0:23365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be216ae expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789118131.990473:0:23365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789118131.990488:0:23365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be216ae expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.990494:0:23365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789118131.990514:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be216ae expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.990521:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a88d9a400/0xaa253ed19be216a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be216ae expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.990534:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118131.990536:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118131.990538:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118131.990540:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593329792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789118131.990576:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118131.990950:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3645:1876025593329664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789118131.990988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118131.991651:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593329792 00000100:00100000:0.0:1789118131.991659:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593329792 00010000:00010000:0.0:1789118131.991689:0:23364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962bbf70d000/0xaa253ed19be216ae lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be216a7 expref: 24 pid: 23372 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118131.991721:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593329664 00000100:00100000:0.0:1789118131.991724:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593329664 00010000:00010000:0.0:1789118131.991737:0:23364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d92000/0xaa253ed19be216bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be216b5 expref: 25 pid: 23369 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118131.991898:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789118131.991906:0:23364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789118131.991911:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+25:3646:x1876025593329792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789118131.991932:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789118131.992113:0:23364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+25:3645:x1876025593329664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789118131.992128:0:23364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789118131.992132:0:23364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d92000/0xaa253ed19be216bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be216b5 expref: 25 pid: 23369 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118131.992144:0:23364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d92000/0xaa253ed19be216bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be216b5 expref: 25 pid: 23369 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118131.992161:0:23364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789118131.992442:0:23393:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf8390c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789118131.992467:0:23393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92000/0xaa253ed19be216bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be216b5 expref: 25 pid: 23369 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118131.992480:0:23393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23393:1876025593329408:0@lo:104: 00000100:00100000:1.0:1789118131.992491:0:23393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf725a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23393:1876025593329536:0@lo:104: 00010000:00010000:1.0:1789118131.992515:0:23393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118131.992643:0:23364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:3645:x1876025593329664:12345-0@lo:103:ldlm_bl.0 Request processed in 534us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118131.992651:0:23364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789118131.992726:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3645:1876025593329664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789118131.993095:0:23363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962bbf70d000/0xaa253ed19be216ae lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be216a7 expref: 25 pid: 23372 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.993110:0:23363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962bbf70d000/0xaa253ed19be216ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be216a7 expref: 23 pid: 23372 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.993123:0:23363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962bbf70d000/0xaa253ed19be216ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be216a7 expref: 23 pid: 23372 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.994549:0:23363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.994560:0:23363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789118131.994580:0:23363:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.022695690s 00010000:00010000:2.0:1789118131.994587:0:23363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.994594:0:23363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.994601:0:23363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.994607:0:23363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.994613:0:23363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dba00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118131.994617:0:23363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.994633:0:23363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.994656:0:23363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.994670:0:23393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118131.994672:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789118131.994681:0:23393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118131.994688:0:23393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b813dba00/0xaa253ed19be2181a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118131.994750:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:3646:x1876025593329792:12345-0@lo:103:ldlm_bl.0 Request processed in 2842us (4171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118131.994760:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789118131.996351:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593329792:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1789118132.002071:0:25705:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789118132.002082:0:25705:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789118132.002116:0:25705:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789118132.002175:0:25705:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789118132.002199:0:25705:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789118132.002223:0:25705:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789118132.003015:0:25705:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789118132.003287:0:25705:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789118132.262711:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789118132.583697:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789118132.583722:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593329920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789118132.583801:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118132.583898:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593329920 00000100:00100000:0.0:1789118132.583906:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593329920 00000100:00100000:0.0:1789118132.583958:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789118132.583968:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf725a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593329920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789118132.584000:0:24894:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789118132.584048:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf725a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593329920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118132.584078:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789118132.584217:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593329920:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1789118133.261938:0:25775:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789118133.262540:0:25775:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789118133.286204:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789118133.349327:0:23375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789118133.349336:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962bbf6a7800 from 14 10000000:01000000:2.0:1789118133.349343:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789118133.349396:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93e00/0xaa253ed19be21821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118133.349408:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d93e00/0xaa253ed19be21821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118133.349421:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d93e00/0xaa253ed19be21821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118133.349456:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593330048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789118133.349535:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118133.349585:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f57e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789118133.349775:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593330048 00000100:00100000:1.0:1789118133.349783:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593330048 00000100:00100000:1.0:1789118133.349836:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789118133.349855:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:23375:x1876025593330048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789118133.349869:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118133.349885:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813daa00/0xaa253ed19be21828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be21821 expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118133.349919:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813daa00/0xaa253ed19be21828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be21821 expref: 23 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118133.349930:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813daa00/0xaa253ed19be21828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be21821 expref: 23 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118133.349940:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813daa00, rc 0) 00000100:00100000:1.0:1789118133.349997:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:23375:x1876025593330048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118133.350005:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789118133.350064:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593330048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789118133.350082:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d93e00/0xaa253ed19be21821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21828 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118133.350091:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d93e00/0xaa253ed19be21821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21828 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118133.350162:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593330176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789118133.350202:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118133.350229:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a87e4ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789118133.351144:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593330176 00000100:00100000:1.0:1789118133.351154:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593330176 00000100:00100000:1.0:1789118133.351213:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789118133.351224:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:23375:x1876025593330176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789118133.351249:0:23370:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789118133.351268:0:23370:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789118133.351270:0:23370:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1789118133.351423:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:23375:x1876025593330176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 201us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118133.351431:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789118133.351912:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593330176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789118133.352001:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789118133.352012:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93e00/0xaa253ed19be21821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21828 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118133.352028:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d93e00/0xaa253ed19be21821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21828 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789118133.352038:0:23375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789118133.352040:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff962a8795a800 from 14 10000000:01000000:2.0:1789118133.352043:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789118133.352124:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92a00/0xaa253ed19be2182f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118133.352132:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d92a00/0xaa253ed19be2182f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118133.352141:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d92a00/0xaa253ed19be2182f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118133.352167:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593330304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789118133.352217:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118133.352253:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f57b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789118133.352514:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593330304 00000100:00100000:1.0:1789118133.352521:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593330304 00000100:00100000:1.0:1789118133.352559:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789118133.352566:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:23375:x1876025593330304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789118133.352584:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118133.352599:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813db600/0xaa253ed19be21836 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be2182f expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118133.352620:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813db600/0xaa253ed19be21836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be2182f expref: 24 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118133.352629:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813db600/0xaa253ed19be21836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2182f expref: 24 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118133.352637:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db600, rc 0) 00000100:00100000:1.0:1789118133.352687:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:23375:x1876025593330304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118133.352693:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789118133.353280:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593330304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789118133.353310:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d92a00/0xaa253ed19be2182f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21836 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118133.353321:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d92a00/0xaa253ed19be2182f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21836 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118133.353384:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593330432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789118133.353429:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118133.353478:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962a85f57b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789118133.353554:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593330432 00000100:00100000:3.0:1789118133.353562:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593330432 00000100:00100000:3.0:1789118133.353606:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789118133.353615:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:23375:x1876025593330432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789118133.353635:0:23372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789118133.353656:0:23372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789118133.353660:0:23372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1789118133.353759:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:23375:x1876025593330432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118133.353767:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789118133.353817:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593330432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789118133.353884:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789118133.353891:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d92a00/0xaa253ed19be2182f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21836 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118133.353899:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d92a00/0xaa253ed19be2182f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21836 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118134.322596:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118135.333445:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789118135.653487:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789118135.653557:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593330560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789118135.653663:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118135.653944:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593330560 00000100:00100000:3.0:1789118135.653955:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593330560 00000100:00100000:3.0:1789118135.654084:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789118135.654097:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593330560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789118135.654137:0:24894:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789118135.654196:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593330560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118135.654205:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789118135.654272:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593330560:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789118135.654440:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789118136.357358:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118136.677387:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789118136.677413:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593330688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789118136.677447:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789118136.677460:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593330816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789118136.679664:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118136.679898:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593330816 00000100:00100000:0.0:1789118136.679907:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593330816 00000100:00100000:0.0:1789118136.679982:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789118136.679992:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593330816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789118136.680032:0:23383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789118136.680125:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593330816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118136.680132:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789118136.680265:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593330816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789118136.685405:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118136.685735:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593330688 00000100:00100000:0.0:1789118136.685749:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593330688 00000100:00100000:0.0:1789118136.685834:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789118136.685847:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593330688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789118136.685904:0:24121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789118136.686323:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593330688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 478us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118136.686332:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789118136.691986:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593330688:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1789118137.190774:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118137.190782:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789118137.190788:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962b90578800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789118137.190814:0:14597:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff962b90578800 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118137.190843:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a4c000 x1876025593331328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789118137.190895:0:14597:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789118137.190898:0:14597:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789118137.190900:0:14597:0:(import.c:65:import_set_state_nolock()) ffff962a86836000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789118137.190906:0:14597:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff962a86836000 using connection 192.168.204.130@tcp/0@lo 00000100:00100000:3.0:1789118137.190917:0:14597:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff962bc1a4cf00 x1876025593331840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789118137.190978:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593331072:0@lo:400:kworker.0 00000100:00100000:3.0:1789118137.191115:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118137.191174:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593331712:0@lo:400:kworker.0 00000100:00100000:0.0:1789118137.191396:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593331456:0@lo:400:kworker.0 00000100:00100000:0.0:1789118137.191456:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118137.191492:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593332096:0@lo:400:kworker.0 00000100:00100000:0.0:1789118137.191522:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118137.191548:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789118137.191555:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593330944:0@lo:400:kworker.0 00000100:00100000:0.0:1789118137.191602:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118137.191629:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593331584:0@lo:400:kworker.0 00000100:00100000:0.0:1789118137.191651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118137.191669:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593332224:0@lo:400:kworker.0 00000100:00100000:0.0:1789118137.191689:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118137.191743:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593330944 00000100:00100000:0.0:1789118137.191755:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593330944 00000100:00100000:0.0:1789118137.191810:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789118137.191820:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:3646:x1876025593330944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118137.191876:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:3646:x1876025593330944:12345-0@lo:400:kworker.0 Request processed in 58us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118137.191883:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789118137.191936:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593331072 00000100:00100000:0.0:1789118137.191940:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593331072 00000100:00100000:0.0:1789118137.191966:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593331584 00000100:00100000:0.0:1789118137.191969:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593331584 00000100:00100000:0.0:1789118137.191983:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789118137.191989:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593331072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118137.192022:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593331072:12345-0@lo:400:kworker.0 Request processed in 33us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118137.192029:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789118137.192039:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789118137.192045:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593331584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118137.192094:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593331584:12345-0@lo:400:kworker.0 Request processed in 49us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118137.192101:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789118137.192119:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593331456 00000100:00100000:0.0:1789118137.192122:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593331456 00000100:00100000:0.0:1789118137.192143:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593332096 00000100:00100000:0.0:1789118137.192146:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593332096 00000100:00100000:0.0:1789118137.192184:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593332224 00000100:00100000:0.0:1789118137.192187:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593332224 00000100:00100000:0.0:1789118137.192200:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789118137.192205:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593331456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118137.192265:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593331456:12345-0@lo:400:kworker.0 Request processed in 59us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118137.192272:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789118137.192285:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789118137.192291:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593332096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118137.192317:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593332096:12345-0@lo:400:kworker.0 Request processed in 27us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118137.192322:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789118137.192341:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789118137.192347:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593332224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118137.192373:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf776940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593332224:12345-0@lo:400:kworker.0 Request processed in 27us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118137.192379:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789118137.192406:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789118137.192410:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789118137.192436:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593330944:0@lo:400:kworker.0 00000100:00100000:0.0:1789118137.192449:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593331584:0@lo:400:kworker.0 00010000:00080000:0.0:1789118137.192460:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4fc00 x1876025593332224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118137.192469:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593332224:0@lo:400:kworker.0 00010000:00080000:0.0:1789118137.192479:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4e1c0 x1876025593331456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118137.192486:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593331456:0@lo:400:kworker.0 00010000:00080000:0.0:1789118137.192506:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4c780 x1876025593332096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118137.192514:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593332096:0@lo:400:kworker.0 00000100:00100000:1.0:1789118137.193091:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593331328:0@lo:8:kworker.0 00000100:00100000:1.0:1789118137.193171:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118137.193200:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593331840:0@lo:8:kworker.0 00000100:00100000:1.0:1789118137.193258:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118137.193296:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593331328 00000100:00100000:1.0:1789118137.193301:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593331328 00000100:00100000:1.0:1789118137.193328:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593331840 00000100:00100000:1.0:1789118137.193340:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593331840 00000100:00100000:1.0:1789118137.193356:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789118137.193361:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf727840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593331328:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789118137.193395:0:24890:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 789 last 0 00000020:00000080:1.0:1789118137.193429:0:24890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa253ed19be2183d 00002000:00100000:1.0:1789118137.193446:0:24890:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff962a86fe3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789118137.193451:0:24890:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789118137.193453:0:24890:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789118137.193664:0:24890:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789118137.193694:0:24890:0:(import.c:65:import_set_state_nolock()) ffff962a86fe2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789118137.193746:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf727840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876025593331328:12345-0@lo:8:kworker.0 Request processed in 383us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118137.193752:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789118137.193770:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789118137.193774:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876025593331840:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789118137.193789:0:24890:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 789 last 0 00000020:00000080:1.0:1789118137.193805:0:24890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xaa253ed19be21844 00002000:00100000:1.0:1789118137.193811:0:24890:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff962a86fe7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398c ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789118137.193814:0:24890:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1789118137.193816:0:24890:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789118137.193838:0:24890:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789118137.193850:0:24890:0:(import.c:65:import_set_state_nolock()) ffff962a86fe3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789118137.193876:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876025593331840:12345-0@lo:8:kworker.0 Request processed in 101us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118137.193882:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789118137.193919:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4c000 x1876025593331328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789118162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789118137.193938:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789118137.193947:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789118137.193952:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789118137.193954:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962b90578800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789118137.193971:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789118137.193976:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876025593331328:0@lo:8:kworker.0 00010000:00080000:1.0:1789118137.193988:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4cf00 x1876025593331840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789118162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789118137.193997:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789118137.194001:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789118137.194004:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789118137.194006:0:3643:0:(import.c:65:import_set_state_nolock()) ffff962a86836000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789118137.194022:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789118137.194025:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876025593331840:0@lo:8:kworker.0 00000004:00080000:1.0:1789118137.194098:0:23404:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1789118137.194116:0:23404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23404:1876025593332736:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789118137.194140:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118137.194155:0:23404:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b85d78e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789118137.194163:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789118137.194171:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593332608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789118137.194193:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118137.194216:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593332736 00000100:00100000:1.0:1789118137.194233:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593332736 00000100:00100000:1.0:1789118137.194272:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789118137.194278:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf725e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:23404:x1876025593332736:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789118137.194507:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593332608 00000100:00100000:1.0:1789118137.194512:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593332608 00000100:00100000:1.0:1789118137.194539:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789118137.194545:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd007840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876025593332608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789118137.194562:0:24894:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789118137.194598:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd007840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876025593332608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118137.194604:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789118137.194636:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf724000 x1876025593332608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789118153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118137.194649:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593332608:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789118137.194667:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789118137.194716:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593331200:0@lo:400:kworker.0 00000100:00100000:1.0:1789118137.194740:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118137.194758:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593331968:0@lo:400:kworker.0 00000100:00100000:1.0:1789118137.194782:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118137.194797:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593332480:0@lo:400:kworker.0 00000100:00100000:1.0:1789118137.194816:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118137.194842:0:24891:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789118137.194850:0:24891:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789118137.194965:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593331200 00000100:00100000:1.0:1789118137.194969:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593331200 00000100:00100000:1.0:1789118137.194993:0:24891:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789118137.195001:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789118137.195007:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd006d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593331200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118137.195045:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd006d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593331200:12345-0@lo:400:kworker.0 Request processed in 38us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118137.195148:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789118137.195163:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789118137.195182:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593331200:0@lo:400:kworker.0 00000004:00080000:1.0:1789118137.195391:0:24124:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789118137.195477:0:24124:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 789478422754ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789118137.195483:0:24124:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1789118137.195503:0:23403:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789118137.195560:0:23403:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789478504565ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789118137.195564:0:23403:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789118137.196024:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118137.196192:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593332352:0@lo:400:kworker.0 00000100:00100000:3.0:1789118137.196919:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118137.196957:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593331968 00000100:00100000:3.0:1789118137.196964:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593331968 00000100:00100000:3.0:1789118137.197007:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593332480 00000100:00100000:3.0:1789118137.197011:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593332480 00000100:00100000:3.0:1789118137.197032:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593332352 00000100:00100000:3.0:1789118137.197035:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593332352 00000100:00100000:3.0:1789118137.197049:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789118137.197079:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd0052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593331968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118137.197145:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd0052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876025593331968:12345-0@lo:400:kworker.0 Request processed in 68us (2362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118137.197152:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789118137.197173:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789118137.197180:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd0061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593332480:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1789118137.197657:0:24125:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789118137.197682:0:24125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24125:1876025593332992:0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1789118137.200660:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789118137.200674:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789118137.200710:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789118137.200735:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593332352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118137.200903:0:24125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118137.200949:0:24125:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84b7b780 going to sleep for 11 seconds 00000100:00100000:0.0:1789118137.200988:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593332864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789118137.201021:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118137.201080:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593331712 00000100:00100000:0.0:1789118137.201089:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593331712 00000100:00100000:0.0:1789118137.201140:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593332992 00000100:00100000:0.0:1789118137.201143:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593332992 00000100:00100000:0.0:1789118137.201159:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789118137.201166:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593331712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118137.201389:0:24891:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789118137.201398:0:24891:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1789118137.202392:0:25927:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789118137.202410:0:25927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789118137.202422:0:25927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:24125:x1876025593332992:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789118137.204261:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd0061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876025593332480:12345-0@lo:400:kworker.0 Request processed in 7072us (9433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118137.204275:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789118137.204394:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4ed00 x1876025593331968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118137.204412:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876025593331968:0@lo:400:kworker.0 00010000:00080000:3.0:1789118137.204433:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4f480 x1876025593332480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118137.204443:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876025593332480:0@lo:400:kworker.0 00000100:00100000:3.0:1789118137.204535:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593331072:0@lo:400:kworker.0 00000100:00100000:3.0:1789118137.204549:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593331712:0@lo:400:kworker.0 00000100:00100000:3.0:1789118137.204596:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593332864 00000100:00100000:3.0:1789118137.204602:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593332864 00000100:00100000:3.0:1789118137.204644:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789118137.204708:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1876025593332864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789118137.204737:0:24894:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789118137.204810:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1876025593332864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (3788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118137.204817:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789118137.204921:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7770c0 x1876025593332864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789118153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118137.204941:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593332864:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789118137.205050:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789118137.205079:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789118137.205688:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593331712:12345-0@lo:400:kworker.0 Request processed in 4519us (9662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118137.205699:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1789118137.206823:0:24113:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789118137.207023:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593332352:12345-0@lo:400:kworker.0 Request processed in 6296us (10098us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118137.207037:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1789118137.207178:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bc1a4cb40 x1876025593332352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118137.207193:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593332352:0@lo:400:kworker.0 00002000:00080000:0.0:1789118137.209972:0:25927:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789118137.209982:0:25927:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00002000:00080000:2.0:1789118137.210294:0:24890:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789118137.210306:0:24890:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:2.0:1789118137.210315:0:24890:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00000100:00100000:0.0:1789118137.210561:0:25927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:24125:x1876025593332992:12345-0@lo:7:osp-pre-1-1.0 Request processed in 8137us (9653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118137.210573:0:25927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789118137.210643:0:24125:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7743c0 x1876025593332992/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789118153 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118137.210659:0:24125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24125:1876025593332992:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789118137.210686:0:24125:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789118137.210733:0:24125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24125:1876025593333120:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789118137.210783:0:24125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118137.210812:0:24125:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789118137.210836:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593333120 00000100:00100000:0.0:1789118137.210842:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593333120 00000100:00100000:0.0:1789118137.210893:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789118137.210906:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24125:x1876025593333120:12345-0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789118137.210926:0:23357:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1789118137.210939:0:24891:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1789118137.210977:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24125:x1876025593333120:12345-0@lo:5:osp-pre-1-1.0 Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118137.210984:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789118137.211013:0:24125:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7743c0 x1876025593333120/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789118153 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118137.211023:0:24125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24125:1876025593333120:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789118137.211032:0:24125:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789118137.211084:0:24125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24125:1876025593333248:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789118137.211196:0:24125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118137.211234:0:24125:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b84f40b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789118137.211247:0:25927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593333248 00000100:00100000:0.0:1789118137.211251:0:25927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593333248 00000100:00100000:0.0:1789118137.211277:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789118137.211283:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9277fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24125:x1876025593333248:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789118137.211311:0:24891:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:2.0:1789118137.236373:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789118137.236388:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be2184b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.236405:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=789s v=(0 0) 00010000:00010000:2.0:1789118137.236410:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118137.236416:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be2184b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.236434:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be2184b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.236455:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be2184b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.236462:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be2184b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.236480:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789118137.236643:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118137.236651:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be2184b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.236660:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92e00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118137.236664:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be2184b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.236673:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be2184b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.236692:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be2184b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.236699:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be2184b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.236718:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.236727:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.236729:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789118137.237593:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789118137.237601:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e04ffe7/0xaa253ed19be21852 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.237612:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=789s v=(0 0) 00010000:00010000:2.0:1789118137.237617:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118137.237623:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e04ffe7/0xaa253ed19be21852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.237635:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e04ffe7/0xaa253ed19be21852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.237645:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e04ffe7/0xaa253ed19be21852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.237652:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e04ffe7/0xaa253ed19be21852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.237677:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789118137.237805:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118137.237818:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e04ffe7/0xaa253ed19be21852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.237827:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93c00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118137.237831:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e04ffe7/0xaa253ed19be21852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.237840:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e04ffe7/0xaa253ed19be21852 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.237855:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e04ffe7/0xaa253ed19be21852 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.237862:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e04ffe7/0xaa253ed19be21852 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.237879:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.237881:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.237883:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789118137.240473:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789118137.240490:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057954554/0xaa253ed19be21859 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.240506:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=789s v=(0 0) 00010000:00010000:2.0:1789118137.240510:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118137.240517:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057954554/0xaa253ed19be21859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.240540:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057954554/0xaa253ed19be21859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.240552:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057954554/0xaa253ed19be21859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.240560:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057954554/0xaa253ed19be21859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.240665:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1789118137.241687:0:25706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1789118137.241712:0:25706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789118137.241718:0:25706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789118137.242108:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9277fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:24125:x1876025593333248:12345-0@lo:5:osp-pre-1-1.0 Request processed in 30821us (30908us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789118137.242123:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789118137.242184:0:24125:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1789118137.242192:0:24125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24125:1876025593333248:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789118137.242209:0:24125:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1789118137.242271:0:24125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:24125:1876025593333376:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789118137.242320:0:24125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118137.242346:0:24125:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbf8393c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789118137.242369:0:23389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593333376 00000100:00100000:2.0:1789118137.242375:0:23389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593333376 00000100:00100000:2.0:1789118137.242419:0:23389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789118137.242428:0:23389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:24125:x1876025593333376:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789118137.242523:0:23389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:24125:x1876025593333376:12345-0@lo:900:osp-pre-1-1.0 Request processed in 97us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118137.242538:0:23389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789118137.242571:0:24125:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b988a0000 x1876025593333376/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789118153 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118137.242582:0:24125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:24125:1876025593333376:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1789118137.243316:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789118137.243326:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073111453/0xaa253ed19be21860 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.243341:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=789s v=(0 0) 00010000:00010000:0.0:1789118137.243352:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789118137.243359:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073111453/0xaa253ed19be21860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.243373:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073111453/0xaa253ed19be21860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.243385:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073111453/0xaa253ed19be21860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.243392:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073111453/0xaa253ed19be21860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.246319:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789118137.246809:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789118137.246820:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057954554/0xaa253ed19be21859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.246833:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93a00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118137.246838:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057954554/0xaa253ed19be21859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.246849:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057954554/0xaa253ed19be21859 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.246868:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057954554/0xaa253ed19be21859 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.246888:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057954554/0xaa253ed19be21859 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.246912:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118137.246916:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073111453/0xaa253ed19be21860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.246921:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b8ee64200 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118137.246924:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073111453/0xaa253ed19be21860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.246932:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073111453/0xaa253ed19be21860 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.246941:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073111453/0xaa253ed19be21860 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.246947:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073111453/0xaa253ed19be21860 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.246959:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.246961:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.246963:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.247750:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789118137.249117:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789118137.249133:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004797672d/0xaa253ed19be21867 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.249159:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=789s v=(0 0) 00010000:00010000:0.0:1789118137.249163:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789118137.249170:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004797672d/0xaa253ed19be21867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.249185:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004797672d/0xaa253ed19be21867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.249195:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004797672d/0xaa253ed19be21867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.249202:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004797672d/0xaa253ed19be21867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.249228:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789118137.249665:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789118137.249672:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070f90de4/0xaa253ed19be2186e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.249680:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=789s v=(0 0) 00010000:00010000:0.0:1789118137.249683:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789118137.249687:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070f90de4/0xaa253ed19be2186e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.249696:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070f90de4/0xaa253ed19be2186e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.249717:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070f90de4/0xaa253ed19be2186e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.249724:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070f90de4/0xaa253ed19be2186e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.249750:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789118137.250101:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789118137.250107:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001423f98c/0xaa253ed19be21875 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.250114:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=789s v=(0 0) 00010000:00010000:0.0:1789118137.250117:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789118137.250121:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001423f98c/0xaa253ed19be21875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.250130:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001423f98c/0xaa253ed19be21875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.250136:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001423f98c/0xaa253ed19be21875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.250143:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001423f98c/0xaa253ed19be21875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.250162:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789118137.250332:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789118137.250341:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004797672d/0xaa253ed19be21867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.250349:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b8ee65c00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118137.250353:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004797672d/0xaa253ed19be21867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.250362:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004797672d/0xaa253ed19be21867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.250379:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004797672d/0xaa253ed19be21867 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.250387:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004797672d/0xaa253ed19be21867 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.250406:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789118137.250410:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070f90de4/0xaa253ed19be2186e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.250426:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b8ee65000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118137.250429:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070f90de4/0xaa253ed19be2186e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.250436:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070f90de4/0xaa253ed19be2186e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.250446:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070f90de4/0xaa253ed19be2186e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.250453:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070f90de4/0xaa253ed19be2186e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.250465:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118137.250468:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001423f98c/0xaa253ed19be21875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.250474:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b8ee64e00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118137.250477:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001423f98c/0xaa253ed19be21875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.250484:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001423f98c/0xaa253ed19be21875 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.250494:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001423f98c/0xaa253ed19be21875 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.250507:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001423f98c/0xaa253ed19be21875 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.250608:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789118137.250747:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789118137.250753:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e264b3ae/0xaa253ed19be2187c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.250761:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=789s v=(0 0) 00010000:00010000:0.0:1789118137.250764:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789118137.250768:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e264b3ae/0xaa253ed19be2187c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.250777:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e264b3ae/0xaa253ed19be2187c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.250785:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e264b3ae/0xaa253ed19be2187c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.250792:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e264b3ae/0xaa253ed19be2187c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.250814:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789118137.250838:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118137.251298:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.251301:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.251303:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789118137.251474:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789118137.251482:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be21883 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.251491:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=789s v=(0 0) 00010000:00010000:2.0:1789118137.251495:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118137.251499:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be21883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.251510:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be21883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.251529:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be21883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.251536:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be21883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.251554:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789118137.251675:0:25929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789118137.251681:0:25929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be21883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.251692:0:25929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92e00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118137.251696:0:25929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be21883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.251716:0:25929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be21883 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.251734:0:25929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be21883 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.251742:0:25929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd644a7/0xaa253ed19be21883 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.251765:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e264b3ae/0xaa253ed19be2187c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.251772:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f4a00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118137.251776:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e264b3ae/0xaa253ed19be2187c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.251783:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e264b3ae/0xaa253ed19be2187c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.251792:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.251796:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e264b3ae/0xaa253ed19be2187c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.251804:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e264b3ae/0xaa253ed19be2187c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.251831:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.251833:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.251836:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.251842:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.251844:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.251845:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789118137.252555:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789118137.252571:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098d2a218/0xaa253ed19be2188a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.252583:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=789s v=(0 0) 00010000:00010000:2.0:1789118137.252587:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118137.252593:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098d2a218/0xaa253ed19be2188a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.252606:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098d2a218/0xaa253ed19be2188a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.252615:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098d2a218/0xaa253ed19be2188a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.252622:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098d2a218/0xaa253ed19be2188a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.252644:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789118137.252669:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118137.252675:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098d2a218/0xaa253ed19be2188a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.252683:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93200 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118137.252694:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098d2a218/0xaa253ed19be2188a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.252701:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098d2a218/0xaa253ed19be2188a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.252715:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098d2a218/0xaa253ed19be2188a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.252723:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098d2a218/0xaa253ed19be2188a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.252738:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.252740:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.252741:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789118137.253047:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789118137.253085:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ce58800/0xaa253ed19be21891 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.253353:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=789s v=(0 0) 00010000:00010000:2.0:1789118137.253358:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118137.253362:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ce58800/0xaa253ed19be21891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.253375:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ce58800/0xaa253ed19be21891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.253392:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ce58800/0xaa253ed19be21891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.253400:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ce58800/0xaa253ed19be21891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.253418:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789118137.253523:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789118137.253531:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ce58800/0xaa253ed19be21891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.253541:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118137.253544:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ce58800/0xaa253ed19be21891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.253552:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ce58800/0xaa253ed19be21891 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.253567:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ce58800/0xaa253ed19be21891 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.253574:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ce58800/0xaa253ed19be21891 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.253591:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.253593:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.253594:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118137.261357:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.261372:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21898 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.261404:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.261410:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.261418:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.261433:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.261443:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.261451:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.261486:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789118137.261952:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.261960:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2189f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.261969:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.261973:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.261978:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2189f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262012:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2189f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262021:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2189f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262028:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2189f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262046:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789118137.262465:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.262472:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be218a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262482:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.262486:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.262490:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be218a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262500:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be218a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262509:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be218a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262528:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be218a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262543:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789118137.262640:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789118137.262648:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262656:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9a400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118137.262660:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262668:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21898 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262684:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21898 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262691:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21898 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262715:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789118137.262718:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2189f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262734:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9a600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118137.262737:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2189f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262745:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2189f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262755:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2189f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262762:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2189f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262774:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789118137.262777:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be218a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262783:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9ba00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118137.262786:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be218a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262793:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be218a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262802:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be218a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262816:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be218a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.262827:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.262829:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.262831:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.262845:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.262960:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118137.264019:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.264030:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.264042:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.264047:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.264082:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.264105:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.264114:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.264121:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.264137:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789118137.264261:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118137.264267:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.264274:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9b800 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118137.264278:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.264286:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.264300:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.264307:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.264337:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.264339:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.264341:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118137.265445:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.265463:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be218b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.265475:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.265479:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.265483:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be218b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.265496:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be218b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.265506:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be218b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.265514:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be218b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.265527:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789118137.265745:0:25929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118137.265753:0:25929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be218b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.265762:0:25929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9ae00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118137.265766:0:25929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be218b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.265776:0:25929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be218b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.265793:0:25929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be218b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.265807:0:25929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be218b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.265827:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.265829:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.265830:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118137.266403:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.266411:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.266420:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.266423:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.266428:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.266438:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.266452:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.266458:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.266490:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789118137.266566:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789118137.266573:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118137.266582:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789118137.266586:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118137.266595:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118137.266610:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118137.266630:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118137.266647:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118137.266649:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118137.266650:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118137.267268:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.267277:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000048cb404/0xaa253ed19be218c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.267287:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.267289:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.267294:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000048cb404/0xaa253ed19be218c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.267304:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000048cb404/0xaa253ed19be218c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.267312:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000048cb404/0xaa253ed19be218c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.267319:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000048cb404/0xaa253ed19be218c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.267362:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789118137.268135:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118137.268143:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000048cb404/0xaa253ed19be218c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.268153:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d200 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118137.268158:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000048cb404/0xaa253ed19be218c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.268167:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000048cb404/0xaa253ed19be218c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.268183:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000048cb404/0xaa253ed19be218c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.268191:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000048cb404/0xaa253ed19be218c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.268208:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.268210:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.268212:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118137.268236:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.268243:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be218c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.268251:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.268255:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.268259:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be218c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.268269:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be218c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.268277:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be218c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.268285:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be218c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.268304:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789118137.268798:0:25929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118137.268806:0:25929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be218c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.268813:0:25929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118137.268817:0:25929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be218c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.268823:0:25929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be218c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.268836:0:25929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be218c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.268843:0:25929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088914707/0xaa253ed19be218c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.268864:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.268865:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.268867:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118137.269271:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.269279:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eea0cc3f/0xaa253ed19be218d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.269300:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.269310:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.269316:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eea0cc3f/0xaa253ed19be218d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.269330:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eea0cc3f/0xaa253ed19be218d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.269348:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eea0cc3f/0xaa253ed19be218d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.269356:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eea0cc3f/0xaa253ed19be218d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.270029:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789118137.271768:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789118137.271781:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eea0cc3f/0xaa253ed19be218d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118137.271795:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70de00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:1.0:1789118137.271800:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eea0cc3f/0xaa253ed19be218d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118137.271810:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eea0cc3f/0xaa253ed19be218d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118137.271832:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eea0cc3f/0xaa253ed19be218d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118137.271840:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eea0cc3f/0xaa253ed19be218d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118137.271871:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118137.271873:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118137.271874:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118137.272660:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.272671:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000343ff11/0xaa253ed19be218d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.272685:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.272689:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.272707:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000343ff11/0xaa253ed19be218d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.272721:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000343ff11/0xaa253ed19be218d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.272731:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000343ff11/0xaa253ed19be218d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.272746:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000343ff11/0xaa253ed19be218d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.272771:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789118137.273393:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118137.273402:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000343ff11/0xaa253ed19be218d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.273424:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118137.273427:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000343ff11/0xaa253ed19be218d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.273435:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000343ff11/0xaa253ed19be218d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.273451:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000343ff11/0xaa253ed19be218d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.273459:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000343ff11/0xaa253ed19be218d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.273483:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.273484:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.273486:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118137.273751:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.273758:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf5dc37/0xaa253ed19be218de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.273767:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.273770:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.273776:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bf5dc37/0xaa253ed19be218de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.273786:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bf5dc37/0xaa253ed19be218de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.273795:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf5dc37/0xaa253ed19be218de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.273803:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bf5dc37/0xaa253ed19be218de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.273837:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789118137.274288:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.274295:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4f57dda/0xaa253ed19be218e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.274310:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.274313:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.274317:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4f57dda/0xaa253ed19be218e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.274327:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4f57dda/0xaa253ed19be218e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.274461:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4f57dda/0xaa253ed19be218e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.274470:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4f57dda/0xaa253ed19be218e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.274493:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789118137.274553:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789118137.274559:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bf5dc37/0xaa253ed19be218de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.274568:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118137.274571:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf5dc37/0xaa253ed19be218de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.274580:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf5dc37/0xaa253ed19be218de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.274614:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bf5dc37/0xaa253ed19be218de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.274621:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bf5dc37/0xaa253ed19be218de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.274638:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118137.274642:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4f57dda/0xaa253ed19be218e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.274648:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70cc00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118137.274652:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4f57dda/0xaa253ed19be218e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.274659:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4f57dda/0xaa253ed19be218e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.274670:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4f57dda/0xaa253ed19be218e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.274678:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4f57dda/0xaa253ed19be218e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.274689:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.274691:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.274698:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118137.274767:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118137.275180:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.275187:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be218ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.275197:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.275200:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.275204:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be218ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.275214:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be218ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.275248:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be218ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.275255:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be218ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.275270:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789118137.276476:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.276486:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.276497:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.276500:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.276505:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.276516:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.276524:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.276531:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.276559:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789118137.277739:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.277750:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.277761:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.277765:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.277769:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.277781:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.277790:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.277798:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.277816:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789118137.278353:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.278361:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be21901 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.278369:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.278388:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.278392:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be21901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.278403:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be21901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.278412:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be21901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.278420:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be21901 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.278428:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789118137.278955:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.278961:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be21908 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.278969:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.278972:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.278976:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be21908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.278995:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be21908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.279004:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be21908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.279018:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be21908 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.279028:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1789118137.279272:0:25929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789118137.279282:0:25929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be218ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279291:0:25929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70c400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118137.279296:0:25929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be218ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279305:0:25929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be218ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279324:0:25929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be218ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279332:0:25929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000598e082a/0xaa253ed19be218ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279355:0:25929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789118137.279359:0:25929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279366:0:25929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118137.279369:0:25929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279377:0:25929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279399:0:25929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279405:0:25929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e884b54/0xaa253ed19be218f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279418:0:25929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789118137.279421:0:25929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279427:0:25929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9b800 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118137.279430:0:25929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279437:0:25929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279445:0:25929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279452:0:25929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027a58705/0xaa253ed19be218fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279463:0:25929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789118137.279467:0:25929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be21901 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279479:0:25929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9ae00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118137.279483:0:25929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be21901 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279491:0:25929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be21901 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279501:0:25929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be21901 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279508:0:25929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095df44b1/0xaa253ed19be21901 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789118137.279604:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.279610:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2190f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.279619:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.279622:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.279626:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2190f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.279636:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2190f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.279642:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2190f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.279649:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2190f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.279658:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789118137.279735:0:25929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789118137.279740:0:25929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be21908 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279748:0:25929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9ba00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118137.279751:0:25929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be21908 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279759:0:25929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be21908 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279771:0:25929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be21908 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279785:0:25929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074b81f2e/0xaa253ed19be21908 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279798:0:25929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118137.279802:0:25929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2190f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279808:0:25929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9a600 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118137.279811:0:25929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2190f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279819:0:25929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2190f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279832:0:25929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2190f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279840:0:25929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000138d0b9f/0xaa253ed19be2190f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.279853:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.279855:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.279857:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118137.280085:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.280175:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21916 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.280190:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.280193:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.280198:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.280207:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.280224:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.280232:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.280233:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21916 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.280238:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.280248:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789118137.280650:0:25929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789118137.280657:0:25929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21916 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.280673:0:25929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9a400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118137.280677:0:25929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21916 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.280684:0:25929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21916 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.280699:0:25929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21916 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.280706:0:25929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d72eb78e/0xaa253ed19be21916 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118137.280725:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.280727:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789118137.280728:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118137.280817:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.280824:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be2191d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.280832:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.280836:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.280840:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be2191d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.280850:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be2191d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.280872:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be2191d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.280879:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be2191d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.280900:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789118137.280930:0:23365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789118137.280937:0:23365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be2191d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.280945:0:23365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc10400 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118137.280949:0:23365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be2191d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.280957:0:23365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be2191d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.280968:0:23365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be2191d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.280976:0:23365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037aa5e21/0xaa253ed19be2191d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.280990:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.280992:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789118137.280994:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789118137.281942:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789118137.281952:0:24890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be21924 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.281964:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=789s v=(0 0) 00010000:00010000:3.0:1789118137.281967:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789118137.281973:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be21924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.281984:0:24890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be21924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.283187:0:24890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be21924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.283197:0:24890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be21924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118137.290003:0:24890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789118137.290050:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789118137.290078:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be21924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.290106:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11200 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118137.290112:0:23366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be21924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.290126:0:23366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be21924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.290153:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be21924 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.290160:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c025e39/0xaa253ed19be21924 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118137.290186:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.290188:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118137.290189:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789118137.290390:0:24890:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1789118137.290497:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf725e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:23404:x1876025593332736:12345-0@lo:5:osp-pre-1-0.0 Request processed in 96216us (96352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118137.290508:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789118137.291712:0:23404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23404:1876025593332736:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789118137.291730:0:23404:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1789118137.291778:0:23404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23404:1876025593333504:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789118137.291823:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118137.291864:0:23404:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789118137.292643:0:25928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593333504 00000100:00100000:2.0:1789118137.292653:0:25928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593333504 00000100:00100000:2.0:1789118137.292714:0:25928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789118137.292723:0:25928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:23404:x1876025593333504:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789118137.292769:0:25928:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1789118137.294600:0:25928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:23404:x1876025593333504:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1861us (2759us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789118137.294612:0:25928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789118137.294816:0:23404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23404:1876025593333504:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789118137.294845:0:23404:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1789118137.381600:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789118137.643409:0:24138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789118137.701352:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789118137.701379:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88565680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593333632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789118137.701871:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118137.701929:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593333632 00000100:00100000:0.0:1789118137.701938:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593333632 00000100:00100000:0.0:1789118137.701995:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789118137.702006:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593333632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789118137.702045:0:24894:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789118137.702161:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593333632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118137.702169:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789118137.702232:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88565680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593333632:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789118138.411407:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789118139.045752:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789118139.429873:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789118139.834629:0:26068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg430-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789118140.457340:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118140.787334:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789118140.789792:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593333760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789118140.789885:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000004:3.0:1789118140.791904:0:26120:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789118140.792254:0:26120:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789118140.796815:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593333760 00000100:00100000:0.0:1789118140.796833:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593333760 00000100:00100000:0.0:1789118140.796921:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789118140.796934:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593333760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789118140.796967:0:24894:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789118140.797074:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593333760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (7168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118140.797083:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789118140.797146:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593333760:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789118140.797232:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789118141.489723:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118141.797681:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593333888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789118141.797784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118141.797915:0:23383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593333888 00000100:00100000:1.0:1789118141.797928:0:23383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593333888 00000100:00100000:1.0:1789118141.798001:0:23383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789118141.798013:0:23383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593333888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789118141.798080:0:23383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789118141.798260:0:23383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593333888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 249us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118141.798351:0:23383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789118141.798770:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593334016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789118141.798807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118141.798904:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593333888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789118141.799791:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593334016 00000100:00100000:1.0:1789118141.799799:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593334016 00000100:00100000:1.0:1789118141.799850:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789118141.799859:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593334016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789118141.799901:0:23382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789118141.799953:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876025593334016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118141.799959:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789118141.800425:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876025593334016:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1789118141.948024:0:26171:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789118141.949343:0:26171:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789118142.270690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118142.270883:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572223872 00000100:00100000:2.0:1789118142.270894:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572223872 00000100:00100000:2.0:1789118142.270948:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 117 00000100:00100000:2.0:1789118142.270956:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2403:x1876025572223872:12345-192.168.204.30@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789118142.270986:0:23370:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 94fd0678-a106-4c9c-9081-e19ef8362a30@192.168.204.30@tcp t0 exp 0000000000000000 cur 794 last 0 00000020:00000080:2.0:1789118142.271023:0:23370:0:(genops.c:1385:class_connect()) connect: client 94fd0678-a106-4c9c-9081-e19ef8362a30, cookie 0xaa253ed19be2192b 00000100:00080000:2.0:1789118142.271206:0:23370:0:(import.c:65:import_set_state_nolock()) ffff962a87916000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789118142.271270:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+5:2403:x1876025572223872:12345-192.168.204.30@tcp:250:mount.lustre.0 Request processed in 313us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118142.271279:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 117 00000100:00100000:3.0:1789118142.285267:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118142.286525:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572224000 00000100:00100000:0.0:1789118142.286542:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572224000 00000100:00100000:0.0:1789118142.286623:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 118 00000100:00100000:0.0:1789118142.286635:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+5:18379:x1876025572224000:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789118142.286656:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789118142.286676:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a887f4400/0xaa253ed19be21932 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f400 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118142.286714:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a887f4400/0xaa253ed19be21932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f400 expref: 6 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118142.286725:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a887f4400/0xaa253ed19be21932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f400 expref: 6 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118142.286747:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f4400, rc 0) 00000100:00100000:0.0:1789118142.286830:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+6:18379:x1876025572224000:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 197us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118142.286838:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 118 00000100:00100000:0.0:1789118142.294956:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118142.297325:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572224128 00000100:00100000:2.0:1789118142.297340:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572224128 00000100:00100000:2.0:1789118142.297427:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 119 00000100:00100000:2.0:1789118142.297438:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+6:18379:x1876025572224128:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789118142.297588:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+6:18379:x1876025572224128:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 151us (2643us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789118142.297597:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 119 00000100:00100000:3.0:1789118142.307837:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118142.310945:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbd004f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593334144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789118142.311049:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118142.311354:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593334144 00000100:00100000:1.0:1789118142.311363:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593334144 00000100:00100000:1.0:1789118142.311436:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789118142.311449:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593334144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789118142.311494:0:24894:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789118142.311552:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593334144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118142.311583:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789118142.311618:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789118142.311642:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572224256 00000100:00100000:1.0:1789118142.311649:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572224256 00000100:00100000:1.0:1789118142.311691:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:1.0:1789118142.311702:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+6:18379:x1876025572224256:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789118142.311717:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118142.311743:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813db800/0xaa253ed19be21939 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f407 expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118142.311781:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813db800/0xaa253ed19be21939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f407 expref: 7 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118142.311801:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813db800/0xaa253ed19be21939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f407 expref: 7 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118142.311817:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db800, rc 0) 00000100:00100000:2.0:1789118142.311863:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b988a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3645:1876025593334272:0@lo:400:kworker.0 00000100:00100000:1.0:1789118142.311884:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+7:18379:x1876025572224256:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 183us (4063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118142.311897:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 120 00000100:00100000:1.0:1789118142.311949:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593334656:0@lo:400:kworker.0 00000100:00100000:2.0:1789118142.311975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118142.312096:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593334400:0@lo:400:kworker.0 00000100:00100000:1.0:1789118142.313410:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118142.313490:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593335168:0@lo:400:kworker.0 00000100:00100000:1.0:1789118142.313548:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118142.313617:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbd004f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593334144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789118142.313842:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593335168 00000100:00100000:1.0:1789118142.313863:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593335168 00000100:00100000:2.0:1789118142.314210:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593334784:0@lo:400:kworker.0 00000100:00100000:2.0:1789118142.314274:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118142.314299:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593335296:0@lo:400:kworker.0 00000100:00100000:2.0:1789118142.314330:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118142.314389:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593334656 00000100:00100000:2.0:1789118142.314397:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593334656 00000100:00100000:1.0:1789118142.317483:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593335296 00000100:00100000:1.0:1789118142.317506:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593335296 00000100:00100000:3.0:1789118142.324172:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789118142.324208:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd006940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593335168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118142.324365:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd006940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593335168:12345-0@lo:400:kworker.0 Request processed in 173us (10815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118142.324374:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789118142.325166:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118142.325219:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593334272 00000100:00100000:3.0:1789118142.325251:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593334272 00000100:00100000:3.0:1789118142.325310:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572224384 00000100:00100000:3.0:1789118142.325313:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572224384 00000100:00100000:3.0:1789118142.325331:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789118142.325341:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b9c61a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:3645:x1876025593334272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118142.325425:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b9c61a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:3645:x1876025593334272:12345-0@lo:400:kworker.0 Request processed in 85us (13452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118142.325434:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789118142.326297:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b988a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3645:1876025593334272:0@lo:400:kworker.0 00000100:00100000:2.0:1789118142.326355:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 122 00000100:00100000:2.0:1789118142.326450:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8470ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+7:18379:x1876025572224384:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789118142.326635:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8470ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+8:18379:x1876025572224384:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 195us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118142.326643:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 122 00000100:00100000:2.0:1789118142.326723:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593334784 00000100:00100000:2.0:1789118142.326730:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593334784 00000100:00100000:2.0:1789118142.326760:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789118142.326766:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd006580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593334656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118142.326885:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd006580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593334656:12345-0@lo:400:kworker.0 Request processed in 119us (13484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118142.326893:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789118142.326926:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789118142.326932:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593334784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118142.326965:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593334784:12345-0@lo:400:kworker.0 Request processed in 34us (12691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118142.326972:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789118142.327003:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593334784:0@lo:400:kworker.0 00000100:00100000:2.0:1789118142.327081:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118142.328580:0:25927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593334400 00000100:00100000:3.0:1789118142.328609:0:25927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593334400 00000100:00100000:1.0:1789118142.328700:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789118142.328714:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593335296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118142.328815:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876025593335296:12345-0@lo:400:kworker.0 Request processed in 104us (14483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118142.328823:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789118142.328896:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8eedc000 x1876025593335296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118142.328915:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876025593335296:0@lo:400:kworker.0 00000100:00100000:1.0:1789118142.328985:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593334528:0@lo:400:kworker.0 00000100:00100000:1.0:1789118142.329028:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118142.329049:0:25927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789118142.329080:0:25927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593334400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118142.329081:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593335040:0@lo:400:kworker.0 00000100:00100000:1.0:1789118142.329108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118142.329131:0:25927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593334400:12345-0@lo:400:kworker.0 Request processed in 44us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118142.329138:0:25927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789118142.329138:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593335552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789118142.329158:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593334528 00000100:00100000:3.0:1789118142.329162:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593334528 00000100:00100000:1.0:1789118142.329166:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118142.329182:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593335040 00000100:00100000:3.0:1789118142.329184:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593335040 00000100:00100000:1.0:1789118142.329202:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593335552 00000100:00100000:1.0:1789118142.329205:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593335552 00000100:00100000:3.0:1789118142.329206:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789118142.329211:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd004f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593334528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118142.329228:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789118142.329235:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd004b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593335552:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789118142.329245:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd004f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876025593334528:12345-0@lo:400:kworker.0 Request processed in 34us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118142.329251:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00002000:00000024:1.0:1789118142.329255:0:24894:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789118142.329261:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789118142.329266:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd007c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593335040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118142.329286:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd004b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593335552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118142.329292:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789118142.329318:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbf7743c0 x1876025593334528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118142.329348:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876025593334528:0@lo:400:kworker.0 00000100:00100000:1.0:1789118142.329370:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593335552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789118142.329411:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593334656:0@lo:400:kworker.0 00010000:00080000:1.0:1789118142.329428:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8eedfc00 x1876025593335168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118142.329438:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593335168:0@lo:400:kworker.0 00000100:00100000:3.0:1789118142.330018:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd007c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876025593335040:12345-0@lo:400:kworker.0 Request processed in 749us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118142.330037:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789118142.330369:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789118142.330379:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789118142.330383:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789118142.330388:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789118142.332352:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8eedf840 x1876025593335040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118142.332382:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876025593335040:0@lo:400:kworker.0 00000100:00100000:2.0:1789118142.333947:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eede580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593334912:0@lo:400:kworker.0 00000100:00100000:2.0:1789118142.334099:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118142.334180:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b8eedf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593335424:0@lo:400:kworker.0 00000100:00100000:2.0:1789118142.334217:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118142.334244:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593334912 00000100:00100000:3.0:1789118142.334261:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593334912 00000100:00100000:2.0:1789118142.334297:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593334400:0@lo:400:kworker.0 00000100:00100000:0.0:1789118142.334551:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593335424 00000100:00100000:0.0:1789118142.334557:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593335424 00000100:00100000:2.0:1789118142.335523:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789118142.335553:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593335424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118142.335593:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789118142.335618:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eede940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593334912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118142.335658:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593335424:12345-0@lo:400:kworker.0 Request processed in 120us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118142.335668:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1789118142.335738:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8eedf0c0 x1876025593335424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118142.335753:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eedf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593335424:0@lo:400:kworker.0 00000100:00080000:1.0:1789118142.336031:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789118142.336187:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eede940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593334912:12345-0@lo:400:kworker.0 Request processed in 575us (2087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118142.336196:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1789118142.336284:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962b8eede580 x1876025593334912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118142.336296:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b8eede580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593334912:0@lo:400:kworker.0 00000100:00100000:1.0:1789118142.337834:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118142.338041:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572224512 00000100:00100000:2.0:1789118142.338093:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572224512 00000100:00100000:2.0:1789118142.338184:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00100000:2.0:1789118142.338197:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b84708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+8:18379:x1876025572224512:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789118142.338419:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b84708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+8:18379:x1876025572224512:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 222us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118142.338430:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 123 00000100:00100000:0.0:1789118142.346706:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118142.347824:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572224640 00000100:00100000:3.0:1789118142.347845:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572224640 00000100:00100000:3.0:1789118142.347951:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00100000:3.0:1789118142.347965:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b84709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+8:18398:x1876025572224640:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789118142.350402:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b84709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+8:18398:x1876025572224640:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 2419us (3701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118142.350424:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 124 00000100:00100000:2.0:1789118142.392240:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118142.394950:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572224768 00000100:00100000:0.0:1789118142.394976:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572224768 00000100:00100000:0.0:1789118142.395102:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 125 00000100:00100000:0.0:1789118142.395115:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b84709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+8:18398:x1876025572224768:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789118142.395383:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b84709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+8:18398:x1876025572224768:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 269us (3160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118142.395393:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 125 00000100:00100000:1.0:1789118142.399913:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118142.400180:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572224896 00000100:00100000:2.0:1789118142.400199:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572224896 00000100:00100000:2.0:1789118142.400289:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 126 00000100:00100000:2.0:1789118142.400302:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8470bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+8:18398:x1876025572224896:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789118142.400569:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8470bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+8:18398:x1876025572224896:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 269us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118142.400580:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 126 00000100:00100000:3.0:1789118142.411143:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118142.413791:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572225024 00000100:00100000:2.0:1789118142.413817:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572225024 00000100:00100000:2.0:1789118142.413928:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 127 00000100:00100000:2.0:1789118142.413942:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8470a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+8:18379:x1876025572225024:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789118142.413974:0:23370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118142.414009:0:23370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d93c00/0xaa253ed19be21940 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f438 expref: -99 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118142.414107:0:23370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93c00/0xaa253ed19be21940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f438 expref: 9 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118142.414130:0:23370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d93c00/0xaa253ed19be21940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f438 expref: 9 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118142.414141:0:23370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93c00, rc 0) 00000100:00100000:2.0:1789118142.414247:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8470a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+9:18379:x1876025572225024:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 308us (3192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118142.414256:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 127 00000100:00100000:3.0:1789118142.421992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118142.422391:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572225152 00000100:00100000:0.0:1789118142.422406:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572225152 00000100:00100000:0.0:1789118142.422663:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 128 00000100:00100000:0.0:1789118142.422679:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+9:18379:x1876025572225152:12345-192.168.204.30@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789118142.422723:0:23372:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789118142.422759:0:23372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789118142.422764:0:23372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789118142.422774:0:23372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789118142.422778:0:23372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789118142.422781:0:23372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1789118142.434922:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+9:18379:x1876025572225152:12345-192.168.204.30@tcp:256:mount.lustre.0 Request processed in 12230us (12927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118142.434942:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 128 00000100:00100000:3.0:1789118142.443827:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118142.444494:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572225280 00000100:00100000:2.0:1789118142.444511:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572225280 00000100:00100000:2.0:1789118142.444610:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 129 00000100:00100000:2.0:1789118142.444624:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+9:18379:x1876025572225280:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789118142.445110:0:23370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118142.445151:0:23370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92000/0xaa253ed19be21947 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f43f expref: -99 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118142.445193:0:23370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92000/0xaa253ed19be21947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f43f expref: 10 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118142.445206:0:23370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92000/0xaa253ed19be21947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f43f expref: 10 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118142.445240:0:23370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92000, rc 0) 00000100:00100000:2.0:1789118142.445592:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+10:18379:x1876025572225280:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 968us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118142.445611:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 129 00000100:00100000:2.0:1789118142.451425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118142.451635:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572225408 00000100:00100000:0.0:1789118142.451764:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572225408 00000100:00100000:0.0:1789118142.451900:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 130 00000100:00100000:0.0:1789118142.451913:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+10:18379:x1876025572225408:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789118142.452210:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+10:18379:x1876025572225408:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 299us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118142.452221:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 130 00000100:00100000:0.0:1789118142.455975:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118142.456163:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572225536 00000100:00100000:2.0:1789118142.456184:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572225536 00000100:00100000:2.0:1789118142.456270:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 131 00000100:00100000:2.0:1789118142.456283:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+10:18379:x1876025572225536:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789118142.456821:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+10:18379:x1876025572225536:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 537us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118142.456832:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 131 00000100:00100000:3.0:1789118142.467260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118142.468873:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572225664 00000100:00100000:0.0:1789118142.468973:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572225664 00000100:00100000:0.0:1789118142.469173:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 132 00000100:00100000:0.0:1789118142.469190:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+10:18404:x1876025572225664:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789118142.469521:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+10:18404:x1876025572225664:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 334us (2274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118142.469531:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 132 00000100:00100000:2.0:1789118142.474241:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118142.477432:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572225792 00000100:00100000:1.0:1789118142.478450:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572225792 00000100:00100000:1.0:1789118142.478572:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 133 00000100:00100000:1.0:1789118142.478587:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+10:18404:x1876025572225792:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789118142.479181:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+10:18404:x1876025572225792:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 595us (4955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118142.479193:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 133 00000100:00100000:2.0:1789118142.500224:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118142.500474:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00010000:00010000:0.0:1789118142.501907:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118142.505183:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572225920 00000100:00100000:3.0:1789118142.505210:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572225920 00000100:00100000:0.0:1789118142.505832:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572226176 00000100:00100000:0.0:1789118142.505839:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572226176 00000100:00100000:2.0:1789118142.505925:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:2.0:1789118142.505937:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eede580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1876025572225920:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789118142.505977:0:23379:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from d29d87d8-e620-4bf4-8433-b91e751a0764@192.168.204.30@tcp t0 exp 0000000000000000 cur 794 last 0 00000020:00000080:2.0:1789118142.506047:0:23379:0:(genops.c:1385:class_connect()) connect: client d29d87d8-e620-4bf4-8433-b91e751a0764, cookie 0xaa253ed19be2194e 00000004:00100000:2.0:1789118142.506107:0:23379:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789118142.506369:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:1.0:1789118142.506378:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1876025572226176:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789118142.506403:0:23377:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from d29d87d8-e620-4bf4-8433-b91e751a0764@192.168.204.30@tcp t0 exp 0000000000000000 cur 794 last 0 00000100:00080000:2.0:1789118142.507162:0:23379:0:(import.c:65:import_set_state_nolock()) ffff962a87910000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789118142.507304:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eede580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+6:2403:x1876025572225920:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 1363us (7093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118142.507317:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000020:00000080:1.0:1789118142.511174:0:23377:0:(genops.c:1385:class_connect()) connect: client d29d87d8-e620-4bf4-8433-b91e751a0764, cookie 0xaa253ed19be21955 00000004:00100000:1.0:1789118142.511210:0:23377:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789118142.511328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118142.511402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00080000:1.0:1789118142.511492:0:23377:0:(import.c:65:import_set_state_nolock()) ffff962a86fe6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789118142.511569:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+6:2403:x1876025572226176:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 5188us (11093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118142.511583:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:1.0:1789118142.511611:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572226432 00000100:00100000:1.0:1789118142.511619:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572226432 00000100:00100000:1.0:1789118142.511668:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572226048 00000100:00100000:1.0:1789118142.511671:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572226048 00000100:00100000:1.0:1789118142.511686:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1789118142.511694:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+7:18379:x1876025572226432:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789118142.511717:0:23377:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789118142.511783:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+7:18379:x1876025572226432:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 87us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118142.511792:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:1.0:1789118142.511817:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:1.0:1789118142.511826:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+6:0:x1876025572226048:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789118142.511838:0:23377:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00080000:3.0:1789118142.512003:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789118142.513282:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+6:0:x1876025572226048:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 1449us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118142.513295:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:2.0:1789118142.523944:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118142.524035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118142.524469:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572226560 00000100:00100000:0.0:1789118142.524480:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572226560 00000100:00100000:0.0:1789118142.524532:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572226304 00000100:00100000:0.0:1789118142.524536:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572226304 00000100:00100000:0.0:1789118142.524586:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:0.0:1789118142.524597:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8eedc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+6:18379:x1876025572226560:12345-192.168.204.30@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789118142.524721:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8eedc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+6:18379:x1876025572226560:12345-192.168.204.30@tcp:40:mount.lustre.0 Request processed in 126us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118142.524728:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:0.0:1789118142.524743:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:0.0:1789118142.524748:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+6:0:x1876025572226304:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789118142.524759:0:23378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789118142.524798:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+6:0:x1876025572226304:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 51us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118142.524804:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00080000:2.0:1789118142.525289:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789118142.533284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118142.533331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118142.533375:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118142.533591:0:23389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572226944 00000100:00100000:3.0:1789118142.533614:0:23389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572226944 00000100:00100000:3.0:1789118142.533691:0:23389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:3.0:1789118142.533702:0:23389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d29d87d8-e620-4bf4-8433-b91e751a0764+6:18379:x1876025572226944:12345-192.168.204.30@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789118142.533783:0:23389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d29d87d8-e620-4bf4-8433-b91e751a0764+6:18379:x1876025572226944:12345-192.168.204.30@tcp:900:mount.lustre.0 Request processed in 82us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118142.533790:0:23389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:1.0:1789118142.534090:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572226688 00000100:00100000:1.0:1789118142.534095:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572226688 00000100:00100000:1.0:1789118142.534127:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572226816 00000100:00100000:1.0:1789118142.534130:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572226816 00000100:00100000:1.0:1789118142.534156:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:1.0:1789118142.534161:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1876025572226688:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789118142.534189:0:24891:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from d29d87d8-e620-4bf4-8433-b91e751a0764@192.168.204.30@tcp t0 exp 0000000000000000 cur 794 last 0 00000020:00000080:1.0:1789118142.534224:0:24891:0:(genops.c:1385:class_connect()) connect: client d29d87d8-e620-4bf4-8433-b91e751a0764, cookie 0xaa253ed19be2195c 00002000:00100000:1.0:1789118142.534237:0:24891:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d29d87d8-e620-4bf4-8433-b91e751a0764/ffff962bc0d69800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789118142.534248:0:24891:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789118142.534321:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:3.0:1789118142.534327:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1876025572226816:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789118142.534349:0:24892:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from d29d87d8-e620-4bf4-8433-b91e751a0764@192.168.204.30@tcp t0 exp 0000000000000000 cur 794 last 0 00000020:00000080:3.0:1789118142.534369:0:24892:0:(genops.c:1385:class_connect()) connect: client d29d87d8-e620-4bf4-8433-b91e751a0764, cookie 0xaa253ed19be21963 00002000:00100000:3.0:1789118142.534376:0:24892:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d29d87d8-e620-4bf4-8433-b91e751a0764/ffff962a8844f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789118142.534383:0:24892:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789118142.534456:0:24891:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789118142.534492:0:24891:0:(import.c:65:import_set_state_nolock()) ffff962bc0d6a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789118142.534544:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+6:2403:x1876025572226688:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 380us (1210us total) trans 0 rc 0/0 00002000:00080000:3.0:1789118142.534545:0:24892:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1789118142.534556:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00080000:3.0:1789118142.534731:0:24892:0:(import.c:65:import_set_state_nolock()) ffff962a8844a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789118142.534762:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+6:2403:x1876025572226816:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 433us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118142.534770:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:2.0:1789118142.546277:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118142.546546:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572227072 00000100:00100000:3.0:1789118142.546570:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572227072 00000100:00100000:3.0:1789118142.546645:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:3.0:1789118142.546658:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+6:18379:x1876025572227072:12345-192.168.204.30@tcp:33:mount.lustre.0 00000001:00100000:0.0:1789118142.547236:0:25706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d29d87d8-e620-4bf4-8433-b91e751a0764 00000001:00080000:0.0:1789118142.547256:0:25706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000004:00080000:2.0:1789118142.555729:0:23380:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8933us 00000004:00200000:1.0:1789118142.586735:0:23380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789118142.586895:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+6:18379:x1876025572227072:12345-192.168.204.30@tcp:33:mount.lustre.0 Request processed in 40231us (40637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118142.586911:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:2.0:1789118142.821473:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789118142.821499:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593335680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789118142.821581:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118142.821755:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593335680 00000100:00100000:3.0:1789118142.821763:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593335680 00000100:00100000:3.0:1789118142.821856:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789118142.821866:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593335680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789118142.821912:0:24894:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789118142.821982:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593335680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118142.821991:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789118142.822100:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593335680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789118142.839524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118142.843142:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572227200 00000100:00100000:2.0:1789118142.843162:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572227200 00000100:00100000:2.0:1789118142.843247:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:2.0:1789118142.843258:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+6:18429:x1876025572227200:12345-192.168.204.30@tcp:101:mkdir.0 00010000:00010000:2.0:1789118142.843279:0:23378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118142.843308:0:23378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be2196a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f470 expref: -99 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118142.843379:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93800/0xaa253ed19be21971 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118142.843392:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93800/0xaa253ed19be21971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118142.843426:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93800/0xaa253ed19be21971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789118142.843477:0:23378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789118142.843481:0:23378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789118142.843516:0:23378:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93800/0xaa253ed19be21971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118142.843541:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be2196a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f470 expref: 8 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118142.843562:0:23378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93800/0xaa253ed19be21971 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f470 expref: 7 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118142.843569:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832ccb00) 00010000:00010000:2.0:1789118142.843572:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789118142.843575:0:23378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93800, rc 0) 00000100:00100000:2.0:1789118142.843714:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+7:18429:x1876025572227200:12345-192.168.204.30@tcp:101:mkdir.0 Request processed in 458us (4202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118142.843721:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00010000:00010000:2.0:1789118143.526889:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118144.549355:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118144.826825:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118144.827045:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572227328 00000100:00100000:1.0:1789118144.827113:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572227328 00000100:00100000:1.0:1789118144.827248:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:1.0:1789118144.827262:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+7:18481:x1876025572227328:12345-192.168.204.30@tcp:41:lfs.0 00000004:00000024:1.0:1789118144.827326:0:23377:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789118144.827457:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+7:18481:x1876025572227328:12345-192.168.204.30@tcp:41:lfs.0 Request processed in 199us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118144.827466:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00080000:2.0:1789118144.827908:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789118144.833288:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118144.833751:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572227456 00000100:00100000:2.0:1789118144.833765:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572227456 00000100:00100000:2.0:1789118144.833902:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:2.0:1789118144.833919:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+6:18481:x1876025572227456:12345-192.168.204.30@tcp:41:lfs.0 00000004:00000024:2.0:1789118144.833981:0:23378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789118144.834183:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+6:18481:x1876025572227456:12345-192.168.204.30@tcp:41:lfs.0 Request processed in 269us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118144.834192:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00080000:3.0:1789118144.836449:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789118144.838231:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118144.838733:0:24893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572227584 00000100:00100000:1.0:1789118144.838747:0:24893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572227584 00000100:00100000:1.0:1789118144.838911:0:24893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:1.0:1789118144.838924:0:24893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d29d87d8-e620-4bf4-8433-b91e751a0764+6:18481:x1876025572227584:12345-192.168.204.30@tcp:13:lfs.0 00002000:00000024:1.0:1789118144.838973:0:24893:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789118144.839145:0:24893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d29d87d8-e620-4bf4-8433-b91e751a0764+6:18481:x1876025572227584:12345-192.168.204.30@tcp:13:lfs.0 Request processed in 223us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118144.839155:0:24893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00080000:3.0:1789118144.842187:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789118144.842327:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118144.842469:0:24893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572227712 00000100:00100000:2.0:1789118144.842482:0:24893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572227712 00000100:00100000:2.0:1789118144.842706:0:24893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:2.0:1789118144.842720:0:24893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd0043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d29d87d8-e620-4bf4-8433-b91e751a0764+5:18481:x1876025572227712:12345-192.168.204.30@tcp:13:lfs.0 00002000:00000024:2.0:1789118144.842767:0:24893:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789118144.842909:0:24893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd0043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d29d87d8-e620-4bf4-8433-b91e751a0764+5:18481:x1876025572227712:12345-192.168.204.30@tcp:13:lfs.0 Request processed in 193us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118144.842918:0:24893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00080000:3.0:1789118144.844237:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789118144.986656:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118144.987113:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572227840 00000100:00100000:1.0:1789118144.987128:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572227840 00000100:00100000:1.0:1789118144.987334:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 134 00000100:00100000:1.0:1789118144.987348:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+10:18514:x1876025572227840:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789118144.987373:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118144.987401:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813db200/0xaa253ed19be21978 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f477 expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118144.987439:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813db200/0xaa253ed19be21978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f477 expref: 11 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118144.987451:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813db200/0xaa253ed19be21978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f477 expref: 11 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118144.987463:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813db200, rc 0) 00000100:00100000:1.0:1789118144.987601:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+11:18514:x1876025572227840:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 257us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118144.987609:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 134 00000100:00100000:1.0:1789118145.007782:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118145.008537:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572227968 00000100:00100000:2.0:1789118145.008552:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572227968 00000100:00100000:2.0:1789118145.008650:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 135 00000100:00100000:2.0:1789118145.008662:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+11:18514:x1876025572227968:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789118145.008905:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+11:18514:x1876025572227968:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 244us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118145.008914:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 135 00000100:00100000:2.0:1789118145.012766:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118145.013160:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572228096 00000100:00100000:1.0:1789118145.013192:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572228096 00000100:00100000:1.0:1789118145.013430:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 136 00000100:00100000:1.0:1789118145.013444:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+11:18514:x1876025572228096:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789118145.013703:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+11:18514:x1876025572228096:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 262us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118145.013714:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 136 00000100:00100000:3.0:1789118145.017323:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118145.017590:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572228224 00000100:00100000:0.0:1789118145.017605:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572228224 00000100:00100000:0.0:1789118145.017685:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 137 00000100:00100000:0.0:1789118145.017698:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b8ee7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+11:18520:x1876025572228224:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789118145.017951:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b8ee7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+11:18520:x1876025572228224:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 256us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118145.017961:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 137 00000100:00100000:3.0:1789118145.036745:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118145.036921:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572228352 00000100:00100000:0.0:1789118145.036942:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572228352 00000100:00100000:0.0:1789118145.037047:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 138 00000100:00100000:0.0:1789118145.037837:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+11:18520:x1876025572228352:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789118145.039276:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+11:18520:x1876025572228352:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 1439us (2750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118145.039293:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 138 00000100:00100000:3.0:1789118145.043501:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118145.044211:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572228480 00000100:00100000:1.0:1789118145.044227:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572228480 00000100:00100000:1.0:1789118145.044387:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 139 00000100:00100000:1.0:1789118145.044401:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+11:18520:x1876025572228480:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789118145.044733:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+11:18520:x1876025572228480:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 334us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118145.044745:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 139 00000100:00100000:3.0:1789118145.055045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118145.055930:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572228608 00000100:00100000:0.0:1789118145.055948:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572228608 00000100:00100000:0.0:1789118145.056205:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 140 00000100:00100000:0.0:1789118145.056218:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+11:18514:x1876025572228608:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789118145.056245:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789118145.056288:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a887f4800/0xaa253ed19be2197f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f4a8 expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118145.056339:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a887f4800/0xaa253ed19be2197f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4a8 expref: 12 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118145.056354:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a887f4800/0xaa253ed19be2197f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4a8 expref: 12 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118145.056368:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f4800, rc 0) 00000100:00100000:0.0:1789118145.056465:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+12:18514:x1876025572228608:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 250us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118145.056474:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 140 00000100:00100000:3.0:1789118145.060464:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118145.060763:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572228736 00000100:00100000:1.0:1789118145.060779:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572228736 00000100:00100000:1.0:1789118145.060909:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 141 00000100:00100000:1.0:1789118145.060928:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+12:18514:x1876025572228736:12345-192.168.204.30@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789118145.060972:0:23369:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789118145.061016:0:23369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789118145.061020:0:23369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789118145.061024:0:23369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789118145.061026:0:23369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789118145.061029:0:23369:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1789118145.068034:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+12:18514:x1876025572228736:12345-192.168.204.30@tcp:256:mount.lustre.0 Request processed in 7083us (7561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118145.068103:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 141 00000100:00100000:2.0:1789118145.074342:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118145.074443:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572228864 00000100:00100000:0.0:1789118145.074459:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572228864 00000100:00100000:0.0:1789118145.075439:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 142 00000100:00100000:0.0:1789118145.075487:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+12:18514:x1876025572228864:12345-192.168.204.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789118145.075514:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789118145.076165:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a887f4e00/0xaa253ed19be21986 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f4af expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118145.076214:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a887f4e00/0xaa253ed19be21986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4af expref: 13 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118145.076241:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a887f4e00/0xaa253ed19be21986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4af expref: 13 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118145.076259:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f4e00, rc 0) 00000100:00100000:0.0:1789118145.076384:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+13:18514:x1876025572228864:12345-192.168.204.30@tcp:101:mount.lustre.0 Request processed in 904us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118145.076393:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 142 00000100:00100000:3.0:1789118145.079196:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118145.080349:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572228992 00000100:00100000:0.0:1789118145.080370:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572228992 00000100:00100000:0.0:1789118145.080551:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 143 00000100:00100000:0.0:1789118145.080563:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+13:18514:x1876025572228992:12345-192.168.204.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789118145.080811:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+13:18514:x1876025572228992:12345-192.168.204.30@tcp:501:mount.lustre.0 Request processed in 249us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118145.080820:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 143 00000100:00100000:2.0:1789118145.083265:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118145.083763:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572229120 00000100:00100000:0.0:1789118145.083777:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572229120 00000100:00100000:0.0:1789118145.083854:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 144 00000100:00100000:0.0:1789118145.083865:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+13:18514:x1876025572229120:12345-192.168.204.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789118145.084241:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+13:18514:x1876025572229120:12345-192.168.204.30@tcp:503:mount.lustre.0 Request processed in 376us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118145.084262:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 144 00000100:00100000:1.0:1789118145.090253:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118145.090463:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572229248 00000100:00100000:0.0:1789118145.090478:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572229248 00000100:00100000:0.0:1789118145.090562:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 145 00000100:00100000:0.0:1789118145.090573:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+13:18525:x1876025572229248:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789118145.090797:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+13:18525:x1876025572229248:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 224us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118145.090806:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 145 00000100:00100000:2.0:1789118145.094428:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118145.094676:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572229376 00000100:00100000:0.0:1789118145.094691:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572229376 00000100:00100000:0.0:1789118145.094772:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 146 00000100:00100000:0.0:1789118145.094785:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+13:18525:x1876025572229376:12345-192.168.204.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789118145.095026:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+13:18525:x1876025572229376:12345-192.168.204.30@tcp:502:llog_process_th.0 Request processed in 243us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118145.095035:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 146 00000100:00100000:2.0:1789118145.102038:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118145.102161:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118145.102772:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572229504 00000100:00100000:1.0:1789118145.102788:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572229504 00000100:00100000:1.0:1789118145.102854:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572229760 00000100:00100000:1.0:1789118145.102880:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572229760 00000100:00100000:1.0:1789118145.102921:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:1.0:1789118145.102930:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1876025572229504:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789118145.102980:0:23377:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 111424fa-fdc1-423c-8b6a-bf4f0cc9baf9@192.168.204.30@tcp t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:1.0:1789118145.103047:0:23377:0:(genops.c:1385:class_connect()) connect: client 111424fa-fdc1-423c-8b6a-bf4f0cc9baf9, cookie 0xaa253ed19be2198d 00000004:00100000:1.0:1789118145.103134:0:23377:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789118145.103285:0:23377:0:(import.c:65:import_set_state_nolock()) ffff962bc0d6b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789118145.103392:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:2403:x1876025572229504:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 460us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118145.103401:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:1.0:1789118145.103424:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:1.0:1789118145.103428:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1876025572229760:12345-192.168.204.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789118145.103444:0:23377:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 111424fa-fdc1-423c-8b6a-bf4f0cc9baf9@192.168.204.30@tcp t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:1.0:1789118145.103474:0:23377:0:(genops.c:1385:class_connect()) connect: client 111424fa-fdc1-423c-8b6a-bf4f0cc9baf9, cookie 0xaa253ed19be21994 00000004:00100000:1.0:1789118145.103490:0:23377:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789118145.103566:0:23377:0:(import.c:65:import_set_state_nolock()) ffff962bc0d6d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789118145.103593:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:2403:x1876025572229760:12345-192.168.204.30@tcp:38:mount.lustre.0 Request processed in 163us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118145.103601:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:1.0:1789118145.120963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118145.121024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118145.121147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118145.121267:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572229888 00000100:00100000:3.0:1789118145.121281:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572229888 00000100:00100000:3.0:1789118145.121375:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572229632 00000100:00100000:3.0:1789118145.121379:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572229632 00000100:00100000:3.0:1789118145.121394:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572230016 00000100:00100000:3.0:1789118145.121396:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572230016 00000100:00100000:3.0:1789118145.121412:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:3.0:1789118145.121421:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd0070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:0:x1876025572229888:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789118145.121455:0:23379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789118145.121528:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd0070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:0:x1876025572229888:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 107us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118145.121547:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:3.0:1789118145.121569:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:3.0:1789118145.121576:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd005a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+7:0:x1876025572229632:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789118145.121588:0:23379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789118145.121616:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd005a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+7:0:x1876025572229632:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 40us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118145.121622:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:3.0:1789118145.121651:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:3.0:1789118145.121665:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd005e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:18514:x1876025572230016:12345-192.168.204.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789118145.121678:0:23379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789118145.121845:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd005e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:18514:x1876025572230016:12345-192.168.204.30@tcp:41:mount.lustre.0 Request processed in 187us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118145.121852:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00080000:1.0:1789118145.122096:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789118145.122101:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789118145.131044:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118145.131422:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572230144 00000100:00100000:3.0:1789118145.131436:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572230144 00000100:00100000:3.0:1789118145.131559:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:3.0:1789118145.131572:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:18514:x1876025572230144:12345-192.168.204.30@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789118145.131712:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:18514:x1876025572230144:12345-192.168.204.30@tcp:40:mount.lustre.0 Request processed in 143us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118145.131721:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:2.0:1789118145.139425:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118145.139464:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118145.139523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118145.140013:0:23389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572230528 00000100:00100000:0.0:1789118145.140028:0:23389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572230528 00000100:00100000:0.0:1789118145.140142:0:23389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:0.0:1789118145.140154:0:23389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:18514:x1876025572230528:12345-192.168.204.30@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789118145.140263:0:23389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:18514:x1876025572230528:12345-192.168.204.30@tcp:900:mount.lustre.0 Request processed in 111us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118145.140272:0:23389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:1.0:1789118145.140470:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572230272 00000100:00100000:1.0:1789118145.140476:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572230272 00000100:00100000:1.0:1789118145.140530:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572230400 00000100:00100000:1.0:1789118145.140533:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572230400 00000100:00100000:1.0:1789118145.140567:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:1.0:1789118145.140574:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1876025572230272:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789118145.140604:0:24892:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 111424fa-fdc1-423c-8b6a-bf4f0cc9baf9@192.168.204.30@tcp t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:1.0:1789118145.140646:0:24892:0:(genops.c:1385:class_connect()) connect: client 111424fa-fdc1-423c-8b6a-bf4f0cc9baf9, cookie 0xaa253ed19be2199b 00002000:00100000:1.0:1789118145.140661:0:24892:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 111424fa-fdc1-423c-8b6a-bf4f0cc9baf9/ffff962bc0d6d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789118145.140676:0:24892:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789118145.140763:0:24892:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789118145.140801:0:24892:0:(import.c:65:import_set_state_nolock()) ffff962bc0d6e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789118145.140839:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:2403:x1876025572230272:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 265us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118145.140846:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:1.0:1789118145.140862:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:1.0:1789118145.140867:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1876025572230400:12345-192.168.204.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789118145.140883:0:24892:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 111424fa-fdc1-423c-8b6a-bf4f0cc9baf9@192.168.204.30@tcp t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:1.0:1789118145.140903:0:24892:0:(genops.c:1385:class_connect()) connect: client 111424fa-fdc1-423c-8b6a-bf4f0cc9baf9, cookie 0xaa253ed19be219a2 00002000:00100000:1.0:1789118145.140908:0:24892:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 111424fa-fdc1-423c-8b6a-bf4f0cc9baf9/ffff962bc0d68800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789118145.140914:0:24892:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789118145.140964:0:24892:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789118145.140977:0:24892:0:(import.c:65:import_set_state_nolock()) ffff962bc0d68000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789118145.140998:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:2403:x1876025572230400:12345-192.168.204.30@tcp:8:mount.lustre.0 Request processed in 130us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118145.141004:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:1.0:1789118145.143540:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118145.143805:0:23381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572230656 00000100:00100000:2.0:1789118145.143820:0:23381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572230656 00000100:00100000:2.0:1789118145.143945:0:23381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:2.0:1789118145.143961:0:23381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:18514:x1876025572230656:12345-192.168.204.30@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789118145.144175:0:23381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789118145.144315:0:23381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:18514:x1876025572230656:12345-192.168.204.30@tcp:33:mount.lustre.0 Request processed in 357us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118145.144325:0:23381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:2.0:1789118145.325520:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118145.325772:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572230784 00000100:00100000:0.0:1789118145.325786:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572230784 00000100:00100000:0.0:1789118145.325887:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:0.0:1789118145.325899:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:18550:x1876025572230784:12345-192.168.204.30@tcp:101:mkdir.0 00010000:00010000:0.0:1789118145.325927:0:23378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789118145.326225:0:23378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5a00/0xaa253ed19be219a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f4e0 expref: -99 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118145.326320:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4000/0xaa253ed19be219b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118145.326339:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4000/0xaa253ed19be219b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118145.326358:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4000/0xaa253ed19be219b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789118145.327170:0:23378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789118145.327176:0:23378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789118145.327213:0:23378:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4000/0xaa253ed19be219b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118145.327253:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5a00/0xaa253ed19be219a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4e0 expref: 8 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118145.327278:0:23378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4000/0xaa253ed19be219b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4e0 expref: 7 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118145.327288:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832ccb00) 00010000:00010000:0.0:1789118145.327292:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789118145.327296:0:23378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f4000, rc 0) 00000100:00100000:0.0:1789118145.327401:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+7:18550:x1876025572230784:12345-192.168.204.30@tcp:101:mkdir.0 Request processed in 1503us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118145.328136:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00010000:00010000:0.0:1789118145.573466:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118145.893381:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88564b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593335808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789118145.893712:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118145.893895:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593335808 00000100:00100000:0.0:1789118145.893912:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593335808 00000100:00100000:0.0:1789118145.894037:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789118145.894091:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593335808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789118145.894138:0:24894:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1789118145.894147:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789118145.894236:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593335808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 188us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118145.894245:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789118145.894707:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88564b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593335808:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789118146.597632:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789118146.918233:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593335936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789118146.918312:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118146.922868:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789118146.922886:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593336064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789118146.922955:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118146.923009:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593335936 00000100:00100000:1.0:1789118146.923016:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593335936 00000100:00100000:1.0:1789118146.923088:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593336064 00000100:00100000:1.0:1789118146.923092:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593336064 00000100:00100000:1.0:1789118146.923110:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789118146.923119:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd005680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593335936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789118146.923161:0:24121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789118146.923210:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd005680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593335936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (4898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118146.923218:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789118146.923237:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789118146.923243:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbd004780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593336064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789118146.923260:0:24121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789118146.923285:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbd004780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593336064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118146.923291:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789118146.923340:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593336064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789118146.923355:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593335936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789118147.429498:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789118147.429524:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593336192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789118147.429600:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118147.429652:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88567c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593336320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789118147.429677:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118147.430098:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593336192 00000100:00100000:1.0:1789118147.430108:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593336192 00000100:00100000:3.0:1789118147.430164:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593336704:0@lo:400:kworker.0 00000100:00100000:3.0:1789118147.430197:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118147.430218:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593337216:0@lo:400:kworker.0 00000100:00100000:3.0:1789118147.430241:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118147.430273:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789118147.430279:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593336832:0@lo:400:kworker.0 00000100:00100000:1.0:1789118147.430287:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593336320 00000100:00100000:1.0:1789118147.430293:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593336320 00000100:00100000:3.0:1789118147.430310:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118147.430320:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789118147.430328:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593336192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789118147.430359:0:24894:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789118147.430405:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593336192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118147.430414:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789118147.430420:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789118147.430432:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789118147.430440:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bc1a4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593336320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789118147.430451:0:24894:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789118147.430470:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1789118147.430482:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bc1a4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876025593336320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118147.430489:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789118147.430498:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a31a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593336192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789118147.430510:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593336704 00000100:00100000:0.0:1789118147.430516:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593336704 00000100:00100000:1.0:1789118147.430517:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593336448:0@lo:400:kworker.0 00000100:00100000:2.0:1789118147.430531:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88567c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876025593336320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789118147.430560:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118147.430560:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593337216 00000100:00100000:0.0:1789118147.430565:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593337216 00000100:00100000:1.0:1789118147.430596:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593336960:0@lo:400:kworker.0 00000100:00100000:0.0:1789118147.430601:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789118147.430612:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593336704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118147.430625:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118147.430643:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593337472:0@lo:400:kworker.0 00000100:00100000:2.0:1789118147.430644:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593336960 00000100:00100000:2.0:1789118147.430651:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593336960 00000100:00100000:0.0:1789118147.430662:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593336704:12345-0@lo:400:kworker.0 Request processed in 53us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118147.430671:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789118147.430684:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118147.430689:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789118147.430690:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593337472 00000100:00100000:0.0:1789118147.430695:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593337472 00000100:00100000:2.0:1789118147.430700:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593337216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118147.430703:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789118147.430712:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bc1a4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593336576:0@lo:400:kworker.0 00000100:00100000:0.0:1789118147.430720:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789118147.430730:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593336960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118147.430767:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593336448 00000100:00100000:2.0:1789118147.430771:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593337216:12345-0@lo:400:kworker.0 Request processed in 73us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118147.430773:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593336448 00000100:00100000:0.0:1789118147.430782:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593336960:12345-0@lo:400:kworker.0 Request processed in 54us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118147.430783:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789118147.430805:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789118147.430814:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:3646:x1876025593336448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118147.430861:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593337344:0@lo:400:kworker.0 00000100:00100000:1.0:1789118147.430866:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:3646:x1876025593336448:12345-0@lo:400:kworker.0 Request processed in 52us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118147.430876:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789118147.430893:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118147.430909:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593337344 00000100:00100000:1.0:1789118147.430915:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593337344 00000100:00100000:3.0:1789118147.430920:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593336704:0@lo:400:kworker.0 00010000:00080000:3.0:1789118147.430936:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd15680 x1876025593337216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789118147.430954:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593337216:0@lo:400:kworker.0 00000100:00100000:0.0:1789118147.434573:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789118147.434600:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789118147.434635:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593337472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118147.434654:0:25928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593336832 00000100:00100000:0.0:1789118147.434680:0:25928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593336832 00000100:00100000:0.0:1789118147.434747:0:25928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789118147.434755:0:25928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593336832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118147.434854:0:25928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593336832:12345-0@lo:400:kworker.0 Request processed in 100us (4544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118147.434856:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593337472:12345-0@lo:400:kworker.0 Request processed in 239us (4172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118147.434870:0:25928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789118147.434874:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789118147.434930:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789118147.434936:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789118147.434940:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789118147.434992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118147.435011:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593336832:0@lo:400:kworker.0 00000100:00100000:2.0:1789118147.435084:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593337088:0@lo:400:kworker.0 00000100:00100000:0.0:1789118147.435102:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593336576 00000100:00100000:0.0:1789118147.435108:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593336576 00000100:00100000:2.0:1789118147.435137:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118147.435172:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789118147.435177:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593336448:0@lo:400:kworker.0 00000100:00100000:0.0:1789118147.435183:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593336576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118147.435198:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87faa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593336960:0@lo:400:kworker.0 00010000:00080000:2.0:1789118147.435213:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962bbfd14b40 x1876025593337472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118147.435224:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593337472:0@lo:400:kworker.0 00000100:00100000:0.0:1789118147.435238:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593336576:12345-0@lo:400:kworker.0 Request processed in 57us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118147.435246:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789118147.435252:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bc1a4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593336576:0@lo:400:kworker.0 00000100:00080000:0.0:1789118147.435263:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789118147.435275:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593337088 00000100:00100000:0.0:1789118147.435279:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593337088 00000100:00100000:0.0:1789118147.435311:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789118147.435317:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593337088:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789118147.436478:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789118147.437117:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593337088:12345-0@lo:400:kworker.0 Request processed in 1792us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118147.437131:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789118147.439313:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593337088:0@lo:400:kworker.0 00000100:00100000:1.0:1789118147.440360:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789118147.440384:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593337344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118147.440481:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593337344:12345-0@lo:400:kworker.0 Request processed in 109us (9588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118147.440488:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789118147.440544:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593337344:0@lo:400:kworker.0 00010000:00010000:3.0:1789118147.627080:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789118147.880444:0:24138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789118147.943962:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789118147.944006:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88567840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593337600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789118147.944414:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118147.944595:0:24893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593337600 00000100:00100000:0.0:1789118147.944679:0:24893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593337600 00000100:00100000:0.0:1789118147.945008:0:24893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789118147.945085:0:24893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593337600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789118147.945136:0:24893:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789118147.945286:0:24893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593337600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 238us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118147.945295:0:24893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789118147.945423:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88567840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593337600:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789118148.463655:0:24887:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 111424fa-fdc1-423c-8b6a-bf4f0cc9baf9 00000001:00100000:0.0:1789118148.463671:0:24887:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d29d87d8-e620-4bf4-8433-b91e751a0764 00000001:00100000:2.0:1789118148.463733:0:24113:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 111424fa-fdc1-423c-8b6a-bf4f0cc9baf9 00000001:00100000:2.0:1789118148.463753:0:24113:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d29d87d8-e620-4bf4-8433-b91e751a0764 00000001:00100000:1.0:1789118148.465855:0:23357:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 111424fa-fdc1-423c-8b6a-bf4f0cc9baf9 00000001:00100000:1.0:1789118148.466016:0:23357:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d29d87d8-e620-4bf4-8433-b91e751a0764 00000001:02000400:2.0:1789118148.564839:0:26269:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789118148.645849:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789118149.285768:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789118149.677021:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118150.496673:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118150.496729:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118150.496818:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572231168 00000100:00100000:0.0:1789118150.496831:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572231168 00000100:00100000:0.0:1789118150.496925:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:0.0:1789118150.496938:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+5:2406:x1876025572231168:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:0.0:1789118150.497202:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+5:2406:x1876025572231168:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 267us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118150.497212:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00080000:3.0:1789118150.497479:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789118150.500952:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572230912 00000100:00100000:2.0:1789118150.500987:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572230912 00000100:00100000:2.0:1789118150.501121:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 148 00000100:00100000:2.0:1789118150.501136:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+13:2406:x1876025572230912:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789118150.501250:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+13:2406:x1876025572230912:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 117us (4591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118150.501260:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 148 00000001:00100000:0.0:1789118150.511251:0:25706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 111424fa-fdc1-423c-8b6a-bf4f0cc9baf9 00000100:00100000:0.0:1789118150.523898:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118150.524014:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118150.524093:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118150.524159:0:25927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572231296 00000100:00100000:1.0:1789118150.524173:0:25927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572231296 00000100:00100000:1.0:1789118150.524261:0:25927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00100000:1.0:1789118150.524274:0:25927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+5:2407:x1876025572231296:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:1.0:1789118150.524380:0:25927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+5:2407:x1876025572231296:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 108us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118150.524389:0:25927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 12 00000100:00080000:1.0:1789118150.524436:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789118150.535371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118150.535403:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118150.536223:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118150.537182:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572231040 00000100:00100000:2.0:1789118150.537200:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572231040 00000100:00100000:2.0:1789118150.537313:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572231552 00000100:00100000:2.0:1789118150.537318:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572231552 00000100:00100000:2.0:1789118150.537357:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:2.0:1789118150.537371:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+6:2407:x1876025572231040:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789118150.537481:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+6:2407:x1876025572231040:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 113us (13597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118150.537490:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:2.0:1789118150.537512:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:2.0:1789118150.537519:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:2407:x1876025572231552:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789118150.538945:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:2407:x1876025572231552:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 27us (13452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118150.538990:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00080000:3.0:1789118150.539245:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789118150.543775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118150.543895:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572231680 00000100:00100000:2.0:1789118150.543909:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572231680 00000100:00100000:2.0:1789118150.544101:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:2.0:1789118150.544116:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:2406:x1876025572231680:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789118150.544230:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:2406:x1876025572231680:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 118us (8009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118150.544239:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00080000:2.0:1789118150.544271:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789118150.550266:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572231808 00000100:00100000:3.0:1789118150.550290:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572231808 00000100:00100000:3.0:1789118150.550381:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572231424 00000100:00100000:3.0:1789118150.550386:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572231424 00000100:00100000:3.0:1789118150.550410:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572231936 00000100:00100000:3.0:1789118150.550413:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572231936 00000100:00100000:3.0:1789118150.550440:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:3.0:1789118150.550465:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:2407:x1876025572231808:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789118150.550581:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:2407:x1876025572231808:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 119us (15228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118150.550590:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:3.0:1789118150.550609:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:3.0:1789118150.550615:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+5:2406:x1876025572231424:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789118150.550653:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+5:2406:x1876025572231424:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 38us (15250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118150.550660:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:3.0:1789118150.550670:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:3.0:1789118150.550676:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b90a58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:2406:x1876025572231936:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789118150.550695:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b90a58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:2406:x1876025572231936:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 20us (6938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118150.550702:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00080000:3.0:1789118150.551048:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789118150.551086:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789118150.693308:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118151.014943:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88564780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593337728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789118151.015106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118151.015210:0:24894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593337728 00000100:00100000:0.0:1789118151.015223:0:24894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593337728 00000100:00080000:2.0:1789118151.017833:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789118151.019676:0:24894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789118151.019704:0:24894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593337728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789118151.021666:0:24894:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789118151.023311:0:24894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593337728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3598us (8182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118151.023332:0:24894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789118151.024287:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88564780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593337728:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789118151.719314:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118152.037633:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789118152.037670:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88564b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593337856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789118152.037789:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118152.037876:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593337984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789118152.038105:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118152.038160:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593337856 00000100:00100000:0.0:1789118152.038171:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593337856 00000100:00100000:0.0:1789118152.038238:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593337984 00000100:00100000:0.0:1789118152.038241:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593337984 00000100:00100000:0.0:1789118152.038260:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789118152.038801:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593337856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789118152.038859:0:24121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789118152.038965:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593337856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 174us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118152.039099:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88564b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593337856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789118152.049104:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789118152.049137:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593337984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789118152.049196:0:23382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789118152.049681:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593337984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 557us (11623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118152.049692:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789118152.050341:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593337984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789118152.050515:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789118152.549674:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593338496:0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.549776:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118152.549836:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593339008:0@lo:400:kworker.0 00000100:00100000:2.0:1789118152.549849:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593338496 00000100:00100000:2.0:1789118152.549863:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593338496 00000100:00100000:1.0:1789118152.549865:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118152.549888:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593339520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789118152.549935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118152.549946:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593339008 00000100:00100000:2.0:1789118152.549952:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593339008 00000100:00100000:1.0:1789118152.549971:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789118152.549978:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf774780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593338112:0@lo:400:kworker.0 00000100:00100000:2.0:1789118152.550003:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789118152.550018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118152.550020:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593338496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.550047:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593338624:0@lo:400:kworker.0 00000100:00100000:3.0:1789118152.550151:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593338112 00000100:00100000:3.0:1789118152.550156:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593338112 00000100:00100000:3.0:1789118152.550196:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789118152.550206:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:3646:x1876025593338112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118152.550264:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876025593338496:12345-0@lo:400:kworker.0 Request processed in 249us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118152.550266:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:3646:x1876025593338112:12345-0@lo:400:kworker.0 Request processed in 61us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118152.550282:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789118152.550283:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789118152.550310:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789118152.550320:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593339008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118152.550354:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876025593339008:12345-0@lo:400:kworker.0 Request processed in 37us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118152.550679:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789118152.550711:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789118152.552787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118152.552919:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593339136:0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.552968:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118152.553047:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876025593338496:0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.553087:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876025593339008:0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.553123:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf774780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593338112:0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.553166:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf777c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593338240:0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.553192:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118152.553210:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf725e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593338752:0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.553238:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118152.553254:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593339264:0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.553274:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118152.553302:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789118152.553310:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593338368:0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.553334:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118152.553393:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593338880:0@lo:400:kworker.0 00000100:00100000:3.0:1789118152.553631:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593338624 00000100:00100000:3.0:1789118152.553641:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593338624 00000100:00100000:3.0:1789118152.553715:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593338240 00000100:00100000:3.0:1789118152.553718:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593338240 00000100:00100000:3.0:1789118152.553750:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593338752 00000100:00100000:3.0:1789118152.553753:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593338752 00000100:00100000:3.0:1789118152.553765:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593338368 00000100:00100000:3.0:1789118152.553767:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593338368 00000100:00100000:3.0:1789118152.553784:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789118152.553795:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593338624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118152.554236:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593339136 00000100:00100000:2.0:1789118152.554252:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593339136 00000100:00100000:2.0:1789118152.554295:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593339264 00000100:00100000:2.0:1789118152.554298:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593339264 00000100:00100000:2.0:1789118152.554318:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789118152.554325:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593339136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118152.554693:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789118152.554714:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593338240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118152.555771:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876025593339136:12345-0@lo:400:kworker.0 Request processed in 1436us (2792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118152.555787:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789118152.555969:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789118152.555988:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593339264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118152.556047:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876025593339264:12345-0@lo:400:kworker.0 Request processed in 67us (2768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118152.556073:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1789118152.556240:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f46580 x1876025593339136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118152.556268:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876025593339136:0@lo:400:kworker.0 00000100:00100000:0.0:1789118152.560517:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593338240:12345-0@lo:400:kworker.0 Request processed in 5785us (7294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118152.560540:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789118152.560771:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789118152.560802:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593338752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.561711:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118152.561755:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593338752:12345-0@lo:400:kworker.0 Request processed in 960us (8513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118152.561767:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789118152.561789:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593339392:0@lo:400:kworker.0 00000100:00100000:0.0:1789118152.561802:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789118152.561816:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593338368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.561837:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118152.561891:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf777c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593338240:0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.561907:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf725e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593338752:0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.561921:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876025593339264:0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.562179:0:24893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593339520 00000100:00100000:1.0:1789118152.562188:0:24893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593339520 00000100:00100000:1.0:1789118152.562240:0:24893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789118152.562248:0:24893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876025593339520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789118152.562282:0:24893:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789118152.562331:0:24893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876025593339520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (12405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118152.562338:0:24893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789118152.563355:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593338368:12345-0@lo:400:kworker.0 Request processed in 1540us (10014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118152.563428:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593338368:0@lo:400:kworker.0 00000100:00100000:2.0:1789118152.563709:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593338880 00000100:00100000:2.0:1789118152.563718:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593338880 00000100:00100000:1.0:1789118152.563750:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593339648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789118152.563780:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593339392 00000100:00100000:2.0:1789118152.563785:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593339392 00000100:00100000:1.0:1789118152.563804:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118152.563819:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789118152.563855:0:24893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593339648 00000100:00100000:1.0:1789118152.563860:0:24893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593339648 00000100:00100000:1.0:1789118152.563884:0:24893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789118152.563894:0:24893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593339648:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789118152.563899:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00002000:00000024:1.0:1789118152.563917:0:24893:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789118152.563974:0:24893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593339648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118152.563995:0:24893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789118152.564032:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593339648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789118152.564345:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593338880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789118152.564402:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593338624:12345-0@lo:400:kworker.0 Request processed in 10606us (11622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118152.564423:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789118152.564423:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876025593338880:12345-0@lo:400:kworker.0 Request processed in 82us (2715us total) trans 0 rc 0/0 00000100:00080000:3.0:1789118152.564487:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789118152.564495:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789118152.564498:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789118152.564501:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789118152.567229:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876025593338880:0@lo:400:kworker.0 00000100:00100000:0.0:1789118152.569686:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789118152.569730:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593339392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.569816:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593338624:0@lo:400:kworker.0 00000100:00100000:1.0:1789118152.569851:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593339520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789118152.572142:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876025593339392:12345-0@lo:400:kworker.0 Request processed in 2425us (10291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118152.572177:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1789118152.572530:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a87f44000 x1876025593339392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789118152.572550:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876025593339392:0@lo:400:kworker.0 00000100:00100000:2.0:1789118152.573663:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000020:00000080:1.0:1789118152.689631:0:26416:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe676c8d10 20000000:00000080:1.0:1789118152.689659:0:26416:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff962bc0e11000 uarg=0000000000000000 20000000:01000000:1.0:1789118152.689711:0:26416:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789118152.689719:0:26416:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789118152.689726:0:26416:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789118152.691561:0:26417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 19 20000000:00000400:1.0:1789118152.691760:0:26416:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789118152.708018:0:26416:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789118152.708313:0:26416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118152.708334:0:26416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d92600/0xaa253ed19be21614 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2160d expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118152.708342:0:26416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d93400/0xaa253ed19be21622 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2161b expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118152.708348:0:26416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b8ee65200/0xaa253ed19be21661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be2165a expref: 23 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118152.708355:0:26416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962b8ee64400/0xaa253ed19be217db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be217d4 expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118152.708383:0:26416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a87d92000/0xaa253ed19be21947 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f43f expref: 12 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118152.708391:0:26416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff962a887f4e00/0xaa253ed19be21986 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4af expref: 12 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118152.708398:0:26416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118152.708451:0:26416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a887f4e00/0xaa253ed19be21986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4af expref: 12 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118152.708466:0:26416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962a887f4e00/0xaa253ed19be21986 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4af expref: 12 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118152.708481:0:26416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26416:1876025593339776:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789118152.708585:0:26416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d92000/0xaa253ed19be21947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f43f expref: 12 pid: 23370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118152.708594:0:26416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962a87d92000/0xaa253ed19be21947 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f43f expref: 12 pid: 23370 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118152.708602:0:26416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88564b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26416:1876025593339904:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789118152.708634:0:26416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b8ee64400/0xaa253ed19be217db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be217d4 expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118152.708642:0:26416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b8ee64400/0xaa253ed19be217db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be217d4 expref: 23 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118152.708664:0:26416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88567c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26416:1876025593340032:0@lo:104: 00000100:00100000:0.0:1789118152.708706:0:26416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789118152.708741:0:26416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962b8ee65200/0xaa253ed19be21661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be2165a expref: 23 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118152.708749:0:26416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962b8ee65200/0xaa253ed19be21661 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be2165a expref: 23 pid: 23369 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118152.708757:0:26416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a88566940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26416:1876025593340160:0@lo:104: 00000100:00100000:0.0:1789118152.708778:0:26416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789118152.708804:0:26416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d93400/0xaa253ed19be21622 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be2161b expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118152.708811:0:26416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962a87d93400/0xaa253ed19be21622 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be2161b expref: 23 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118152.708818:0:26416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a885652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26416:1876025593340288:0@lo:104: 00000100:00100000:0.0:1789118152.708838:0:26416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789118152.708852:0:26416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff962a87d92600/0xaa253ed19be21614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa253ed19be2160d expref: 23 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118152.708859:0:26416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff962a87d92600/0xaa253ed19be21614 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa253ed19be2160d expref: 23 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118152.708866:0:26416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26416:1876025593340416:0@lo:104: 00000100:00100000:0.0:1789118152.708883:0:26416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118152.708906:0:26416:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bbd0c7540 going to sleep for 11 seconds 00000100:00100000:1.0:1789118152.710319:0:23360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593340032 00000100:00100000:1.0:1789118152.710332:0:23360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593340032 00000100:00100000:1.0:1789118152.710379:0:23360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593340160 00000100:00100000:1.0:1789118152.710383:0:23360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593340160 00000100:00100000:1.0:1789118152.710397:0:23360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593340288 00000100:00100000:1.0:1789118152.710400:0:23360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593340288 00000100:00100000:1.0:1789118152.710416:0:23360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593340416 00000100:00100000:1.0:1789118152.710419:0:23360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593340416 00000100:00100000:1.0:1789118152.710435:0:23360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789118152.710444:0:23360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+6:26416:x1876025593340032:12345-0@lo:104: 00010000:00010000:1.0:1789118152.710461:0:23360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be217db expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.710556:0:23360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789118152.710562:0:23360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+6:26416:x1876025593340032:12345-0@lo:104: Request processed in 119us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118152.710569:0:23360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789118152.710589:0:23360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789118152.710595:0:23360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88565e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+5:26416:x1876025593340160:12345-0@lo:104: 00010000:00010000:1.0:1789118152.710604:0:23360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be21661 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.710640:0:23360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789118152.710644:0:23360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88565e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+5:26416:x1876025593340160:12345-0@lo:104: Request processed in 51us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118152.710650:0:23360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789118152.710663:0:23360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789118152.710668:0:23360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+4:26416:x1876025593340288:12345-0@lo:104: 00010000:00010000:1.0:1789118152.710676:0:23360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be21622 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.710705:0:23360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789118152.710709:0:23360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+4:26416:x1876025593340288:12345-0@lo:104: Request processed in 42us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118152.710714:0:23360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789118152.710726:0:23360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789118152.710730:0:23360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+3:26416:x1876025593340416:12345-0@lo:104: 00010000:00010000:1.0:1789118152.710738:0:23360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be21614 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.710767:0:23360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789118152.710771:0:23360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+3:26416:x1876025593340416:12345-0@lo:104: Request processed in 41us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118152.710776:0:23360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789118152.710802:0:23366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789118152.710808:0:23366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be217db expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.710815:0:23366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93000 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:1.0:1789118152.710819:0:23366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be217db expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.710827:0:23366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be217db expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789118152.710834:0:23366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be217db expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789118152.710839:0:23366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789118152.710881:0:23366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be217db expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711391:0:25929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789118152.711397:0:25929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be21661 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711414:0:25929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b8ee64000 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789118152.711418:0:25929:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be21661 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711424:0:25929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be21661 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789118152.711444:0:25929:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be21661 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118152.711449:0:25929:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789118152.711467:0:25929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be21661 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711473:0:25929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789118152.711496:0:25929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be21661 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711504:0:25929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962b8ee64000/0xaa253ed19be2165a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be21661 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711516:0:25929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789118152.711519:0:25929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be21622 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711525:0:25929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbf70d800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789118152.711528:0:25929:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be21622 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711535:0:25929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be21622 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789118152.711541:0:25929:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be21622 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118152.711546:0:25929:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789118152.711569:0:25929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be21622 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711575:0:25929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789118152.711581:0:25929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be21622 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711587:0:25929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962bbf70d800/0xaa253ed19be2161b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be21622 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711598:0:25929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789118152.711601:0:25929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa253ed19be21614 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711606:0:25929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a88d9a800 already unused, calling callback (ffffffffc13d9c20) 10000000:00010000:3.0:1789118152.711609:0:25929:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa253ed19be21614 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711614:0:25929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa253ed19be21614 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789118152.711620:0:25929:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa253ed19be21614 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118152.711625:0:25929:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789118152.711637:0:25929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be21614 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711642:0:25929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789118152.711656:0:25929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be21614 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711674:0:25929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a88d9a800/0xaa253ed19be2160d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be21614 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.711683:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118152.711684:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118152.711686:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118152.711820:0:23366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789118152.711830:0:23366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be217db expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.711835:0:23366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff962a87d93000/0xaa253ed19be217d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa253ed19be217db expref: -99 pid: 25705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.711858:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118152.711860:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789118152.711862:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789118152.712388:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593340672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789118152.712580:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118152.712638:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789118152.712648:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593340800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789118152.712670:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118152.712714:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593340928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789118152.712734:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118152.712748:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789118152.712752:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a87f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593340544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789118152.712771:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118152.712795:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593340672 00000100:00100000:1.0:1789118152.712802:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593340672 00010000:00010000:1.0:1789118152.712831:0:23362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b8ee65200/0xaa253ed19be21661 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be2165a expref: 24 pid: 23369 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118152.712851:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593340800 00000100:00100000:1.0:1789118152.712854:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593340800 00010000:00010000:1.0:1789118152.712863:0:23362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d93400/0xaa253ed19be21622 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be2161b expref: 25 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118152.712882:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593340928 00000100:00100000:1.0:1789118152.712884:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593340928 00000100:00100000:0.0:1789118152.713186:0:26416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88567c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26416:1876025593340032:0@lo:104: 00000100:00100000:0.0:1789118152.713211:0:26416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88566940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26416:1876025593340160:0@lo:104: 00000100:00100000:0.0:1789118152.713219:0:26416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a885652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26416:1876025593340288:0@lo:104: 00000100:00100000:0.0:1789118152.713236:0:26416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26416:1876025593340416:0@lo:104: 00010000:00010000:1.0:1789118152.713380:0:23362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d92600/0xaa253ed19be21614 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be2160d expref: 26 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118152.713528:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593340544 00000100:00100000:3.0:1789118152.713533:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593340544 00010000:00010000:3.0:1789118152.713551:0:23364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962b8ee64400/0xaa253ed19be217db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be217d4 expref: 27 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118152.713568:0:23364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789118152.713576:0:23364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+27:3644:x1876025593340672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789118152.713590:0:23364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789118152.713596:0:23364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b8ee65200/0xaa253ed19be21661 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be2165a expref: 27 pid: 23369 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.713606:0:23364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b8ee65200/0xaa253ed19be21661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be2165a expref: 27 pid: 23369 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.713624:0:23364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b8ee65200/0xaa253ed19be21661 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be2165a expref: 27 pid: 23369 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.713642:0:23364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789118152.713691:0:23364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+26:3644:x1876025593340672:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118152.713699:0:23364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789118152.713717:0:23364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789118152.713730:0:23364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f45a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+25:3644:x1876025593340800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789118152.713738:0:23364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789118152.713742:0:23364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d93400/0xaa253ed19be21622 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be2161b expref: 25 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.713750:0:23364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d93400/0xaa253ed19be21622 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be2161b expref: 25 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.713760:0:23364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d93400/0xaa253ed19be21622 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be2161b expref: 25 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.713773:0:23364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789118152.713798:0:23364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f45a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:3644:x1876025593340800:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118152.713985:0:23362:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789118152.713994:0:23362:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789118152.714171:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593340800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789118152.714179:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3644:1876025593340672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789118152.714317:0:23364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789118152.714434:0:26416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88566d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26416:1876025593339776:192.168.204.30@tcp:104: 00000100:00100000:1.0:1789118152.714542:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789118152.714552:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f46580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:3646:x1876025593340928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789118152.714561:0:23362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789118152.714566:0:23362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962a87d92600/0xaa253ed19be21614 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be2160d expref: 23 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.714576:0:23362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d92600/0xaa253ed19be21614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be2160d expref: 23 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.714588:0:23362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92600/0xaa253ed19be21614 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be2160d expref: 23 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.714598:0:23362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789118152.714640:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f46580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:3646:x1876025593340928:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118152.714647:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789118152.714661:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789118152.714667:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:3646:x1876025593340544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789118152.714676:0:23362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789118152.714681:0:23362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff962b8ee64400/0xaa253ed19be217db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa253ed19be217d4 expref: 21 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.714688:0:23362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962b8ee64400/0xaa253ed19be217db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa253ed19be217d4 expref: 21 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.714697:0:23362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962b8ee64400/0xaa253ed19be217db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa253ed19be217d4 expref: 21 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.714716:0:23362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789118152.714737:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:3646:x1876025593340544:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118152.714742:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789118152.715107:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a87f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593340544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789118152.715116:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593340928:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789118152.715583:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118152.720981:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118152.721220:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572232064 00000100:00100000:1.0:1789118152.721240:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572232064 00010000:00010000:1.0:1789118152.721287:0:23362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a887f4e00/0xaa253ed19be21986 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4af expref: 13 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118152.721332:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:1.0:1789118152.721342:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94fd0678-a106-4c9c-9081-e19ef8362a30+13:2407:x1876025572232064:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789118152.721362:0:23362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789118152.721368:0:23362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff962a887f4e00/0xaa253ed19be21986 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4af expref: 13 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.721384:0:23362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a887f4e00/0xaa253ed19be21986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4af expref: 13 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.721411:0:23362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a887f4e00/0xaa253ed19be21986 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4af expref: 13 pid: 23372 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.721435:0:23362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789118152.721510:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94fd0678-a106-4c9c-9081-e19ef8362a30+12:2407:x1876025572232064:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 169us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118152.721518:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 13 00000100:00100000:0.0:1789118152.721967:0:26416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a88564b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26416:1876025593339904:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789118152.722006:0:26416:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118152.740626:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118152.740727:0:23364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572232192 00000100:00100000:3.0:1789118152.740742:0:23364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572232192 00010000:00010000:3.0:1789118152.740803:0:23364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff962a87d92000/0xaa253ed19be21947 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f43f expref: 12 pid: 23370 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118152.740860:0:23364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 14 00000100:00100000:3.0:1789118152.740871:0:23364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94fd0678-a106-4c9c-9081-e19ef8362a30+12:2406:x1876025572232192:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789118152.740900:0:23364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789118152.740907:0:23364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff962a87d92000/0xaa253ed19be21947 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f43f expref: 12 pid: 23370 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.740920:0:23364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff962a87d92000/0xaa253ed19be21947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f43f expref: 12 pid: 23370 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.740966:0:23364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a87d92000/0xaa253ed19be21947 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f43f expref: 12 pid: 23370 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.740985:0:23364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.740993:0:23364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.741012:0:23364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.741020:0:23364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.741032:0:23364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.741041:0:23364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.741047:0:23364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f5000 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118152.741096:0:23364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.741108:0:23364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.741129:0:23364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.741158:0:23364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789118152.741248:0:23364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94fd0678-a106-4c9c-9081-e19ef8362a30+11:2406:x1876025572232192:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 377us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118152.741258:0:23364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 14 00010000:00010000:1.0:1789118152.741721:0:26416:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.741745:0:26416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118152.741752:0:26416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff962a887f5000/0xaa253ed19be219b7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118152.742307:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789118153.063218:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789118153.063247:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593341056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789118153.063340:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118153.063551:0:24893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593341056 00000100:00100000:3.0:1789118153.063563:0:24893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593341056 00000100:00100000:3.0:1789118153.063618:0:24893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789118153.063627:0:24893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593341056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789118153.063657:0:24893:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789118153.063716:0:24893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593341056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118153.063723:0:24893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789118153.063847:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593341056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789118153.765323:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118154.101563:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118154.101716:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572232320 00000100:00100000:1.0:1789118154.101730:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572232320 00000100:00100000:1.0:1789118154.101834:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:1.0:1789118154.101845:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+6:19020:x1876025572232320:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789118154.101870:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118154.101910:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da000/0xaa253ed19be219be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f4e7 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.101984:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be219c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.101999:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be219c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102011:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be219c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102027:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dae00/0xaa253ed19be219cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102034:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dae00/0xaa253ed19be219cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102081:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dae00/0xaa253ed19be219cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102179:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da600/0xaa253ed19be219d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102187:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da600/0xaa253ed19be219d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102195:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da600/0xaa253ed19be219d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789118154.102229:0:25722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789118154.102233:0:25722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789118154.102274:0:25722:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da600/0xaa253ed19be219d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102284:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be219c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102291:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be219c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102298:0:25722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be219c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102304:0:25722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813db400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789118154.102308:0:25722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be219c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102316:0:25722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be219c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102334:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832ccb00) 00010000:00010000:1.0:1789118154.102337:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789118154.102342:0:25722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be219c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102349:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be219c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102363:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dae00/0xaa253ed19be219cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102370:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dae00/0xaa253ed19be219cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102440:0:25722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dae00/0xaa253ed19be219cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102449:0:25722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b813dae00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789118154.102452:0:25722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dae00/0xaa253ed19be219cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102459:0:25722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dae00/0xaa253ed19be219cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102467:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff962b95eadf00) 00010000:00010000:1.0:1789118154.102470:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789118154.102473:0:25722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dae00/0xaa253ed19be219cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102479:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dae00/0xaa253ed19be219cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102532:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da000/0xaa253ed19be219be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4e7 expref: 8 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102548:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813da600/0xaa253ed19be219d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4e7 expref: 7 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.102556:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff962b95eadb00) 00010000:00010000:1.0:1789118154.102558:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789118154.102560:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813da600, rc 0) 00000100:00080000:3.0:1789118154.102728:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789118154.102774:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+7:19020:x1876025572232320:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 931us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118154.102784:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 23 00000100:00100000:2.0:1789118154.112456:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118154.113382:0:23388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572232448 00000100:00100000:0.0:1789118154.113400:0:23388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572232448 00000100:00100000:0.0:1789118154.113517:0:23388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:0.0:1789118154.113531:0:23388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d29d87d8-e620-4bf4-8433-b91e751a0764+7:19020:x1876025572232448:12345-192.168.204.30@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789118154.113670:0:23388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d29d87d8-e620-4bf4-8433-b91e751a0764+7:19020:x1876025572232448:12345-192.168.204.30@tcp:900:lhsmtool_posix.0 Request processed in 142us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118154.113679:0:23388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:0.0:1789118154.120743:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.124177:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572232704 00000100:00100000:2.0:1789118154.124202:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572232704 00000100:00100000:2.0:1789118154.125637:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:2.0:1789118154.125666:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+7:19020:x1876025572232704:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789118154.125700:0:23377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118154.125737:0:23377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be219da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f4ee expref: -99 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.125857:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be219e1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.125876:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be219e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.125890:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be219e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.125921:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be219e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.125929:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be219e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.125936:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be219e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.126110:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be219ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.126138:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be219ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.126147:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be219ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789118154.126160:0:23377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789118154.128993:0:23377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be219e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.129109:0:23377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be219e1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.129119:0:23377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be219e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.129126:0:23377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118154.129131:0:23377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be219e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.129139:0:23377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be219e1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.129160:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff962b95eadb00) 00010000:00010000:2.0:1789118154.129164:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789118154.129170:0:23377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be219e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.129176:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be219e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.129195:0:23377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be219e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.129216:0:23377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be219e8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.129222:0:23377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be219e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.129226:0:23377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118154.129229:0:23377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be219e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.129235:0:23377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be219e8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.129244:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff962b832cc100) 00010000:00010000:2.0:1789118154.129247:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789118154.129409:0:23377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be219e8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.129418:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be219e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.134977:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be219da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4ee expref: 10 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.135010:0:23377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92e00/0xaa253ed19be219ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4ee expref: 9 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.135021:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962b832cca00) 00010000:00010000:2.0:1789118154.135024:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789118154.135037:0:23377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92e00, rc 0) 00000100:00100000:2.0:1789118154.135161:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+9:19020:x1876025572232704:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 9507us (14433us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789118154.135171:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 24 00000100:00100000:1.0:1789118154.144922:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.145035:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572232832 00000100:00100000:2.0:1789118154.145047:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572232832 00000100:00100000:2.0:1789118154.145170:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:3.0:1789118154.145370:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+9:19020:x1876025572232832:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789118154.145676:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+9:19020:x1876025572232832:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 Request processed in 494us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118154.145684:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:3.0:1789118154.157130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118154.160398:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572232960 00000100:00100000:0.0:1789118154.160415:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572232960 00000100:00100000:0.0:1789118154.160536:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:0.0:1789118154.160549:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+5:19020:x1876025572232960:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1789118154.160807:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1789118154.164396:0:23378:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3798us 00000100:00100000:1.0:1789118154.173727:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.176169:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572233088 00000100:00100000:2.0:1789118154.176185:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572233088 00000100:00100000:2.0:1789118154.176255:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:2.0:1789118154.176266:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+9:19026:x1876025572233088:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789118154.176289:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118154.176312:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be219fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f4f5 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176387:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be21a04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176404:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be21a04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176419:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be21a04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176557:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176566:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176574:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176640:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be21a04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176648:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be21a04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176653:0:25722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be21a04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176659:0:25722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118154.176664:0:25722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be21a04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176673:0:25722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be21a04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176686:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832ccb00) 00010000:00010000:2.0:1789118154.176689:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789118154.176693:0:25722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be21a04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176698:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92400/0xaa253ed19be21a04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176792:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176799:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176804:0:25722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176815:0:25722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118154.176818:0:25722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176823:0:25722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176832:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff962b832cc100) 00010000:00010000:2.0:1789118154.176834:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789118154.176837:0:25722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176842:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176874:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be219fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4f5 expref: 10 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176964:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832ccb00) 00010000:00010000:2.0:1789118154.176967:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789118154.176971:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be219fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4f5 expref: 10 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.176981:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93000, rc 0) 00000100:00100000:2.0:1789118154.177169:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+9:19026:x1876025572233088:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 812us (3366us total) trans 0 rc 301/301 00000100:00100000:2.0:1789118154.177178:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 27 00000100:00100000:0.0:1789118154.179148:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+5:19020:x1876025572232960:12345-192.168.204.30@tcp:59:lhsmtool_posix.0 Request processed in 18591us (22021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118154.179161:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:1.0:1789118154.196621:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.197509:0:23386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572233216 00000100:00100000:2.0:1789118154.197537:0:23386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572233216 00000100:00100000:2.0:1789118154.197622:0:23386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:2.0:1789118154.197635:0:23386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf774780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d29d87d8-e620-4bf4-8433-b91e751a0764+9:19026:x1876025572233216:12345-192.168.204.30@tcp:700:lfs.0 00000100:00100000:2.0:1789118154.197773:0:23386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf774780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d29d87d8-e620-4bf4-8433-b91e751a0764+9:19026:x1876025572233216:12345-192.168.204.30@tcp:700:lfs.0 Request processed in 140us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118154.197782:0:23386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1789118154.201026:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.208595:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572233472 00000100:00100000:2.0:1789118154.208616:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572233472 00000100:00100000:2.0:1789118154.208959:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:2.0:1789118154.208972:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf777840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+9:19026:x1876025572233472:12345-192.168.204.30@tcp:36:lfs.0 00010000:00010000:2.0:1789118154.209037:0:23377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789118154.209093:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93800/0xaa253ed19be21971 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f470 expref: 9 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.209115:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832ccb00) 00010000:00010000:2.0:1789118154.209121:0:23377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789118154.209178:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.209193:0:23377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4000/0xaa253ed19be219b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4e0 expref: 5 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.209203:0:23377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.209239:0:23377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4000/0xaa253ed19be219b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4e0 expref: 5 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.209278:0:23377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4000/0xaa253ed19be219b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4e0 expref: 5 pid: 23378 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118154.209295:0:23377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa84780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23377:1876025593341184:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789118154.209415:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789118154.218772:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118154.218948:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572233600 00000100:00100000:1.0:1789118154.218956:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572233600 00000100:00100000:2.0:1789118154.219014:0:23377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa84780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23377:1876025593341184:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789118154.219021:0:23362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4000/0xaa253ed19be219b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4e0 expref: 6 pid: 23378 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.219038:0:23377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118154.219075:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00100000:1.0:1789118154.219085:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:2407:x1876025572233600:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789118154.219102:0:23362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789118154.219114:0:23362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4000/0xaa253ed19be219b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4e0 expref: 6 pid: 23378 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.219147:0:23362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4000/0xaa253ed19be219b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4e0 expref: 6 pid: 23378 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.219172:0:23362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4000/0xaa253ed19be219b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4e0 expref: 6 pid: 23378 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.219188:0:23362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832ccb00) 00010000:00010000:1.0:1789118154.219194:0:23362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.219202:0:23362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.219211:0:23362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.219240:0:23362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789118154.219285:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:2407:x1876025572233600:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 202us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118154.219293:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 15 00000100:00080000:0.0:1789118154.219753:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789118154.219802:0:23377:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.219811:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.219833:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a19 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.219844:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.219852:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.222004:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4600/0xaa253ed19be21a20 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.222025:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4600/0xaa253ed19be21a20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.222036:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4600/0xaa253ed19be21a20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789118154.222244:0:23377:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e2654099 reply state 00000000425f4333 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4600/0xaa253ed19be21a20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.222256:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4600/0xaa253ed19be21a20 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.222263:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff962b82d62900) 00010000:00010000:0.0:1789118154.222266:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789118154.222270:0:23377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789118154.222276:0:23377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789118154.222285:0:23377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.222290:0:23377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.222304:0:23377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.222310:0:23377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789118154.222314:0:23377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.222321:0:23377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.222331:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962b832ccb00) 00010000:00010000:0.0:1789118154.222333:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789118154.222348:0:23377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.222354:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21a12 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789118154.222373:0:23377:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e2654099 reply state 00000000425f4333 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.222390:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.222396:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff962b832cc100) 00010000:00010000:0.0:1789118154.222398:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789118154.222400:0:23377:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789118154.222527:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf777840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+10:19026:x1876025572233472:12345-192.168.204.30@tcp:36:lfs.0 Request processed in 13555us (21508us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789118154.222536:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:0.0:1789118154.274848:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118154.274956:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572233728 00000100:00100000:3.0:1789118154.274973:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572233728 00000100:00100000:3.0:1789118154.275102:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 150 00000100:00100000:3.0:1789118154.275115:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+11:18394:x1876025572233728:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789118154.275163:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789118154.275190:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbbc11200/0xaa253ed19be21a27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f4fc expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.275225:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbbc11200/0xaa253ed19be21a27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4fc expref: 12 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.275238:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbbc11200/0xaa253ed19be21a27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f4fc expref: 12 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.275249:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc11200, rc 0) 00000100:00100000:3.0:1789118154.275322:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+12:18394:x1876025572233728:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 210us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118154.275331:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 150 00000100:00100000:0.0:1789118154.283369:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118154.283584:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572233856 00000100:00100000:3.0:1789118154.283596:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572233856 00000100:00100000:3.0:1789118154.283673:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 151 00000100:00100000:3.0:1789118154.283684:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+12:18394:x1876025572233856:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789118154.283886:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+12:18394:x1876025572233856:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 203us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118154.283905:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 151 00000100:00100000:1.0:1789118154.295691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118154.295824:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572233984 00000100:00100000:0.0:1789118154.295836:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572233984 00000100:00100000:0.0:1789118154.295913:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 152 00000100:00100000:0.0:1789118154.295924:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+12:18394:x1876025572233984:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789118154.296120:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+12:18394:x1876025572233984:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 197us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118154.296130:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 152 00000100:00100000:1.0:1789118154.316623:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118154.316739:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572234112 00000100:00100000:3.0:1789118154.316753:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572234112 00000100:00100000:3.0:1789118154.316820:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 153 00000100:00100000:3.0:1789118154.316830:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962badd63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+12:18394:x1876025572234112:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789118154.316848:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789118154.316883:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbbc11a00/0xaa253ed19be21a2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f503 expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.316927:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbbc11a00/0xaa253ed19be21a2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f503 expref: 13 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.316939:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbbc11a00/0xaa253ed19be21a2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f503 expref: 13 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.316948:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc11a00, rc 0) 00000100:00100000:3.0:1789118154.317012:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962badd63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94fd0678-a106-4c9c-9081-e19ef8362a30+13:18394:x1876025572234112:12345-192.168.204.30@tcp:101:ll_cfg_requeue.0 Request processed in 182us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118154.317019:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 153 00000100:00100000:1.0:1789118154.321988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118154.325588:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572234240 00000100:00100000:3.0:1789118154.325604:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572234240 00000100:00100000:1.0:1789118154.326139:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118154.326246:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572234368 00000100:00100000:3.0:1789118154.326250:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572234368 00000100:00100000:3.0:1789118154.326314:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:3.0:1789118154.326324:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b988a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+10:19034:x1876025572234368:12345-192.168.204.30@tcp:101:lctl.0 00010000:00010000:3.0:1789118154.326359:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789118154.326394:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10600/0xaa253ed19be21a35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f50a expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.326476:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10800/0xaa253ed19be21a3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.326491:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10800/0xaa253ed19be21a3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.326503:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10800/0xaa253ed19be21a3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789118154.326559:0:25722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789118154.326562:0:25722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789118154.326597:0:25722:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10800/0xaa253ed19be21a3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.326621:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10600/0xaa253ed19be21a35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f50a expref: 12 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.326639:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc10800/0xaa253ed19be21a3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f50a expref: 11 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.326647:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aed00) 00010000:00010000:3.0:1789118154.326650:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789118154.326654:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc10800, rc 0) 00000100:00100000:3.0:1789118154.326721:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b988a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+11:19034:x1876025572234368:12345-192.168.204.30@tcp:101:lctl.0 Request processed in 398us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118154.326727:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:2.0:1789118154.331678:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 154 00000100:00100000:2.0:1789118154.331695:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+13:18394:x1876025572234240:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789118154.331926:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94fd0678-a106-4c9c-9081-e19ef8362a30+13:18394:x1876025572234240:12345-192.168.204.30@tcp:501:ll_cfg_requeue.0 Request processed in 234us (9948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118154.331953:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 154 00000100:00100000:1.0:1789118154.335407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118154.335644:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572234496 00000100:00100000:3.0:1789118154.335656:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572234496 00000100:00100000:3.0:1789118154.335711:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 155 00000100:00100000:3.0:1789118154.335721:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+13:18394:x1876025572234496:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789118154.336503:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+13:18394:x1876025572234496:12345-192.168.204.30@tcp:503:ll_cfg_requeue.0 Request processed in 779us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118154.336514:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 155 10000000:01000000:1.0:1789118154.341229:0:23375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789118154.341243:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962a89067000 from 19 10000000:01000000:1.0:1789118154.341251:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789118154.341361:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be21a43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.341581:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be21a43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.341596:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be21a43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118154.341636:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593341312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789118154.341733:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118154.341788:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8ef88600 going to sleep for 11 seconds 00000100:00100000:3.0:1789118154.345932:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593341312 00000100:00100000:3.0:1789118154.345948:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593341312 00000100:00100000:2.0:1789118154.348739:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789118154.348775:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+20:23375:x1876025593341312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789118154.348799:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118154.348824:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d93800/0xaa253ed19be21a4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be21a43 expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.348859:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d93800/0xaa253ed19be21a4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be21a43 expref: 21 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.348873:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d93800/0xaa253ed19be21a4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be21a43 expref: 21 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.348883:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93800, rc 0) 00000100:00100000:2.0:1789118154.349001:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:23375:x1876025593341312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 246us (7268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118154.349008:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789118154.349130:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf7243c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593341312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789118154.349151:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be21a43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21a4a expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.349161:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be21a43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21a4a expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118154.349270:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593341440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789118154.349313:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118154.351509:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b86facf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789118154.351546:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593341440 00000100:00100000:1.0:1789118154.351556:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593341440 00000100:00100000:1.0:1789118154.351604:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789118154.351613:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:23375:x1876025593341440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789118154.351855:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:23375:x1876025593341440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (2541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118154.351863:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789118154.352019:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593341440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789118154.352226:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa84780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593341568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789118154.352296:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118154.352500:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64180 going to sleep for 11 seconds 00000100:00100000:1.0:1789118154.352548:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593341568 00000100:00100000:1.0:1789118154.352554:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593341568 00000100:00100000:1.0:1789118154.352630:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789118154.352641:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:23375:x1876025593341568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789118154.352800:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:23375:x1876025593341568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118154.352807:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789118154.352875:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa84780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593341568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789118154.353990:0:26431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789118154.354387:0:23375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789118154.354417:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789118154.354429:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be21a43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21a4a expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.354441:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962b813da000/0xaa253ed19be21a43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21a4a expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118154.354453:0:23375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789118154.354455:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962b90883800 from 19 10000000:01000000:3.0:1789118154.354459:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789118154.354500:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc10600/0xaa253ed19be21a51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.354507:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbbc10600/0xaa253ed19be21a51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.354517:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbbc10600/0xaa253ed19be21a51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118154.354556:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593341696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789118154.354619:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118154.354946:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b86facf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789118154.355039:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593341696 00000100:00100000:2.0:1789118154.355047:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593341696 00000100:00100000:2.0:1789118154.355099:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789118154.355108:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+21:23375:x1876025593341696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789118154.355122:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118154.355135:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962a87d92400/0xaa253ed19be21a58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be21a51 expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.355166:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962a87d92400/0xaa253ed19be21a58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be21a51 expref: 22 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.355178:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962a87d92400/0xaa253ed19be21a58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be21a51 expref: 22 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.355187:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92400, rc 0) 00000100:00100000:2.0:1789118154.355237:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:23375:x1876025593341696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118154.355244:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789118154.355350:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593341696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789118154.355365:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbbc10600/0xaa253ed19be21a51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21a58 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.355381:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbbc10600/0xaa253ed19be21a51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21a58 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118154.355447:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593341824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789118154.355472:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118154.355496:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b86facf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789118154.357556:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593341824 00000100:00100000:2.0:1789118154.357572:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593341824 00000100:00100000:2.0:1789118154.357644:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789118154.357656:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:23375:x1876025593341824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789118154.357877:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:23375:x1876025593341824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (2403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118154.357885:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789118154.358520:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593341824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789118154.358578:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593341952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789118154.358649:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118154.358695:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b86facf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789118154.359509:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593341952 00000100:00100000:2.0:1789118154.359518:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593341952 00000100:00100000:2.0:1789118154.359563:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789118154.359574:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:23375:x1876025593341952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789118154.359746:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:23375:x1876025593341952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118154.359754:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789118154.360141:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593341952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789118154.361259:0:26432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789118154.361852:0:23375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789118154.361883:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789118154.361920:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc10600/0xaa253ed19be21a51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21a58 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.361932:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbbc10600/0xaa253ed19be21a51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21a58 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789118154.361944:0:23375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789118154.361947:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962bbf6a7800 from 19 10000000:01000000:2.0:1789118154.361950:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789118154.361994:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93200/0xaa253ed19be21a5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.362002:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962a87d93200/0xaa253ed19be21a5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.362013:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962a87d93200/0xaa253ed19be21a5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118154.362040:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593342080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789118154.362144:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118154.362194:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64240 going to sleep for 11 seconds 00000100:00100000:3.0:1789118154.362402:0:23369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593342080 00000100:00100000:3.0:1789118154.362412:0:23369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593342080 00000100:00100000:3.0:1789118154.362468:0:23369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789118154.362478:0:23369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+22:23375:x1876025593342080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789118154.362493:0:23369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789118154.362517:0:23369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962bbbc10a00/0xaa253ed19be21a66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be21a5f expref: -99 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.362551:0:23369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962bbbc10a00/0xaa253ed19be21a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be21a5f expref: 23 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.362561:0:23369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962bbbc10a00/0xaa253ed19be21a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be21a5f expref: 23 pid: 23369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.362569:0:23369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc10a00, rc 0) 00000100:00100000:3.0:1789118154.362625:0:23369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:23375:x1876025593342080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118154.362634:0:23369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789118154.362782:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593342080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789118154.362798:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962a87d93200/0xaa253ed19be21a5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21a66 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.362807:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962a87d93200/0xaa253ed19be21a5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21a66 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118154.362869:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593342208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789118154.362919:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118154.362947:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64240 going to sleep for 11 seconds 00000100:00100000:1.0:1789118154.363013:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593342208 00000100:00100000:1.0:1789118154.363019:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593342208 00000100:00100000:1.0:1789118154.363069:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789118154.363077:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:23375:x1876025593342208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789118154.363225:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:23375:x1876025593342208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118154.363232:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789118154.363323:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593342208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789118154.363388:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593342336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789118154.363432:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118154.363460:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64240 going to sleep for 11 seconds 00000100:00100000:1.0:1789118154.363565:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593342336 00000100:00100000:1.0:1789118154.363570:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593342336 00000100:00100000:1.0:1789118154.363589:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789118154.363595:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:23375:x1876025593342336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789118154.363679:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:23375:x1876025593342336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118154.363686:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789118154.364092:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593342336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789118154.365041:0:26433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789118154.365265:0:23375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789118154.365292:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789118154.365305:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962a87d93200/0xaa253ed19be21a5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21a66 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.365316:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962a87d93200/0xaa253ed19be21a5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21a66 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789118154.365327:0:23375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789118154.365330:0:23375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff962a8795a800 from 19 10000000:01000000:3.0:1789118154.365342:0:23375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789118154.365388:0:23375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be21a6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.365396:0:23375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be21a6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.365405:0:23375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be21a6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118154.365448:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593342464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789118154.365508:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118154.365550:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b86faccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789118154.365676:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593342464 00000100:00100000:1.0:1789118154.365682:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593342464 00000100:00100000:1.0:1789118154.365727:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789118154.365736:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+23:23375:x1876025593342464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789118154.365748:0:23372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118154.365760:0:23372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff962b813dae00/0xaa253ed19be21a74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa253ed19be21a6d expref: -99 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.365783:0:23372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff962b813dae00/0xaa253ed19be21a74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa253ed19be21a6d expref: 24 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.365792:0:23372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff962b813dae00/0xaa253ed19be21a74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa253ed19be21a6d expref: 24 pid: 23372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.365800:0:23372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dae00, rc 0) 00000100:00100000:1.0:1789118154.365844:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:23375:x1876025593342464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118154.365857:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789118154.365938:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593342464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789118154.365951:0:23375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be21a6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21a74 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.365959:0:23375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be21a6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa253ed19be21a74 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118154.366012:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593342592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789118154.366041:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118154.366093:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64300 going to sleep for 11 seconds 00000100:00100000:1.0:1789118154.366138:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593342592 00000100:00100000:1.0:1789118154.366143:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593342592 00000100:00100000:1.0:1789118154.366162:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789118154.366168:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:23375:x1876025593342592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789118154.366292:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:23375:x1876025593342592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118154.366299:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789118154.366498:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593342592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789118154.366526:0:23375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593342720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789118154.366568:0:23375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118154.366594:0:23375:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64300 going to sleep for 11 seconds 00000100:00100000:1.0:1789118154.366638:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593342720 00000100:00100000:1.0:1789118154.366643:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593342720 00000100:00100000:1.0:1789118154.366661:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789118154.366667:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:23375:x1876025593342720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789118154.366748:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:23375:x1876025593342720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118154.366755:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789118154.366913:0:23375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:23375:1876025593342720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789118154.367875:0:26434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789118154.370302:0:23375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789118154.370523:0:23375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789118154.370539:0:23375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be21a6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21a74 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.370553:0:23375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff962bbbc10000/0xaa253ed19be21a6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa253ed19be21a74 expref: -99 pid: 23375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118154.373552:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118154.373656:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572234624 00000100:00100000:1.0:1789118154.373667:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572234624 00000100:00100000:1.0:1789118154.373737:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:1.0:1789118154.373749:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:19037:x1876025572234624:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:1.0:1789118154.373784:0:23379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118154.373806:0:23379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be21a7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f511 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.373884:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be21a82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.373909:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be21a82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.373921:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be21a82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789118154.373974:0:23379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789118154.373979:0:23379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789118154.374003:0:23379:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be21a82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.374033:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be21a7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f511 expref: 7 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.374202:0:23379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962b813dba00/0xaa253ed19be21a82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f511 expref: 6 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.374212:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aed00) 00010000:00010000:1.0:1789118154.374214:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789118154.374218:0:23379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962b813dba00, rc 0) 00000100:00100000:1.0:1789118154.375168:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:19037:x1876025572234624:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 1416us (1621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118154.375178:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:0.0:1789118154.381417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118154.381492:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572234752 00000100:00100000:3.0:1789118154.381502:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572234752 00000100:00100000:3.0:1789118154.381564:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:3.0:1789118154.381575:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+6:19037:x1876025572234752:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789118154.381596:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789118154.381618:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be21a89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f518 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.381687:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21a90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.381704:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21a90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.381717:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21a90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.381729:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21a97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.381737:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.381744:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382107:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21a9e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382117:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21a9e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382125:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21a9e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789118154.382168:0:25722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789118154.382172:0:25722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789118154.382194:0:25722:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21a9e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382207:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21a90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382213:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21a90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382220:0:25722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21a90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382225:0:25722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789118154.382229:0:25722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21a90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382237:0:25722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21a90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382249:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aed00) 00010000:00010000:3.0:1789118154.382258:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789118154.382265:0:25722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21a90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382271:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21a90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382285:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382290:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21a97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382296:0:25722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21a97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382301:0:25722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1789118154.382304:0:25722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21a97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382310:0:25722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21a97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382317:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff962b832cc100) 00010000:00010000:3.0:1789118154.382320:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789118154.382323:0:25722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21a97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382327:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21a97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382354:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be21a89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f518 expref: 8 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382380:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21a9e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f518 expref: 7 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.382388:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff962b82d62900) 00010000:00010000:3.0:1789118154.382390:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789118154.382392:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc11600, rc 0) 00000100:00100000:3.0:1789118154.382457:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+7:19037:x1876025572234752:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 883us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118154.382466:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 31 00000100:00100000:2.0:1789118154.385945:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118154.386019:0:23388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572234880 00000100:00100000:0.0:1789118154.386028:0:23388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572234880 00000100:00100000:0.0:1789118154.386131:0:23388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:0.0:1789118154.386141:0:23388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:19037:x1876025572234880:12345-192.168.204.30@tcp:900:lfs.0 00000100:00100000:0.0:1789118154.386211:0:23388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:19037:x1876025572234880:12345-192.168.204.30@tcp:900:lfs.0 Request processed in 72us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118154.386219:0:23388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00080000:3.0:1789118154.386556:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789118154.399520:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.399642:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572235136 00000100:00100000:2.0:1789118154.399657:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572235136 00000100:00100000:2.0:1789118154.399740:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:2.0:1789118154.399753:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+7:19037:x1876025572235136:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789118154.399781:0:23377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118154.399813:0:23377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21aa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f51f expref: -99 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789118154.399962:0:23377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789118154.400114:0:23377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21aa5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f51f expref: 9 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.400130:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aed00) 00010000:00010000:2.0:1789118154.400133:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789118154.400138:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21aa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f51f expref: 9 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.400153:0:23377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93600, rc 0) 00000100:00100000:2.0:1789118154.400244:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+8:19037:x1876025572235136:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 493us (738us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1789118154.400253:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 32 00000100:00100000:0.0:1789118154.406449:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000040:00080000:1.0:1789118154.407196:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789118154.407346:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572235392 00000100:00100000:2.0:1789118154.407355:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572235392 00000100:00100000:2.0:1789118154.407417:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:2.0:1789118154.407429:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+8:19037:x1876025572235392:12345-192.168.204.30@tcp:36:lfs.0 00010000:00010000:2.0:1789118154.407497:0:23378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789118154.407537:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11600/0xaa253ed19be21a9e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f518 expref: 8 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.407555:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff962b82d62900) 00010000:00010000:2.0:1789118154.407561:0:23378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789118154.407585:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93a00/0xaa253ed19be21ab3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.407600:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93a00/0xaa253ed19be21ab3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.407612:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93a00/0xaa253ed19be21ab3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789118154.407826:0:23378:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ed751f9e reply state 00000000d27d4107 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93a00/0xaa253ed19be21ab3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.407839:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93a00/0xaa253ed19be21ab3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.407845:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff962b82d62900) 00010000:00010000:2.0:1789118154.407848:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789118154.407851:0:23378:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789118154.407858:0:23378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789118154.407960:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+9:19037:x1876025572235392:12345-192.168.204.30@tcp:36:lfs.0 Request processed in 533us (1522us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789118154.407968:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 33 00000100:00100000:3.0:1789118154.413343:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.416675:0:23381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572235648 00000100:00100000:2.0:1789118154.416693:0:23381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572235648 00000100:00100000:2.0:1789118154.416785:0:23381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:2.0:1789118154.416796:0:23381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+9:19037:x1876025572235648:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:2.0:1789118154.417114:0:23381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+10:19037:x1876025572235648:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 319us (3795us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1789118154.417123:0:23381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:1.0:1789118154.420309:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.420460:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572235904 00000100:00100000:2.0:1789118154.420474:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572235904 00000100:00100000:2.0:1789118154.420554:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:2.0:1789118154.420566:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+10:19037:x1876025572235904:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789118154.420595:0:23377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118154.420622:0:23377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21aba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f526 expref: -99 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.420711:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21ac1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.420725:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.420738:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.420753:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21ac8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.420760:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.420766:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789118154.420870:0:23377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789118154.420969:0:23377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.420978:0:23377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21ac1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.420985:0:23377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21ac1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.420992:0:23377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118154.420997:0:23377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21ac1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.421004:0:23377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21ac1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.421017:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aed00) 00010000:00010000:2.0:1789118154.421020:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789118154.421025:0:23377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21ac1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.421031:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21ac1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.421045:0:23377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.421051:0:23377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.421175:0:23377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.421189:0:23377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118154.421193:0:23377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.421200:0:23377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.421210:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff962b832cc100) 00010000:00010000:2.0:1789118154.421213:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789118154.421216:0:23377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21ac8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.421221:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21ac8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.421263:0:23377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21aba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f526 expref: 12 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.421274:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aed00) 00010000:00010000:2.0:1789118154.421276:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789118154.421280:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21aba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f526 expref: 12 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.421289:0:23377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93600, rc 0) 00000100:00100000:2.0:1789118154.421353:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+11:19037:x1876025572235904:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 790us (1057us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1789118154.421360:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 34 00000100:00100000:0.0:1789118154.427783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118154.427916:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572236032 00000100:00100000:3.0:1789118154.427934:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572236032 00000100:00100000:3.0:1789118154.428033:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:3.0:1789118154.428047:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+11:19037:x1876025572236032:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:3.0:1789118154.428261:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789118154.428289:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be21ad6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f52d expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.428578:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21add lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.428597:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21add lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.428613:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21add lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789118154.428673:0:25722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789118154.428678:0:25722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789118154.428704:0:25722:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21add lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.428738:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be21ad6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f52d expref: 13 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.428762:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21add lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f52d expref: 12 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.428771:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff962b82d62900) 00010000:00010000:3.0:1789118154.428774:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789118154.428778:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962bbbc11400, rc 0) 00000100:00100000:3.0:1789118154.428863:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+12:19037:x1876025572236032:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 819us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118154.428872:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 35 00000100:00100000:2.0:1789118154.433450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118154.433570:0:23381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572236160 00000100:00100000:3.0:1789118154.433583:0:23381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572236160 00000100:00100000:3.0:1789118154.433656:0:23381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:3.0:1789118154.433667:0:23381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+12:19037:x1876025572236160:12345-192.168.204.30@tcp:37:lfs.0 00000100:00100000:2.0:1789118154.438470:0:23381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+12:19037:x1876025572236160:12345-192.168.204.30@tcp:37:lfs.0 Request processed in 4788us (5014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118154.438485:0:23381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 3 00000100:00100000:0.0:1789118154.443329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118154.443583:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572236416 00000100:00100000:1.0:1789118154.443599:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572236416 00000100:00100000:1.0:1789118154.443672:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:1.0:1789118154.443683:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d79850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+12:19037:x1876025572236416:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789118154.443962:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d79850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+13:19037:x1876025572236416:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 279us (646us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1789118154.443970:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 4 00000100:00100000:3.0:1789118154.517221:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.517351:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572236544 00000100:00100000:2.0:1789118154.517362:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572236544 00000100:00100000:2.0:1789118154.517441:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:2.0:1789118154.517452:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+11:19043:x1876025572236544:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789118154.517475:0:23377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118154.517499:0:23377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21ae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f534 expref: -99 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517579:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21aeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517595:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21aeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517608:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21aeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517621:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21af2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517629:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517634:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517743:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be21af9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517773:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be21af9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517781:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be21af9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789118154.517828:0:23377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789118154.517832:0:23377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789118154.517876:0:23377:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be21af9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517899:0:23377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21aeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517906:0:23377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21aeb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517912:0:23377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21aeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517918:0:23377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118154.517923:0:23377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21aeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517930:0:23377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21aeb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517946:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aed00) 00010000:00010000:2.0:1789118154.517949:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789118154.517955:0:23377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21aeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517972:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21aeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517992:0:23377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.517998:0:23377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21af2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.518004:0:23377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21af2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.518009:0:23377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118154.518011:0:23377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21af2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.518018:0:23377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21af2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.518027:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff962b832cc100) 00010000:00010000:2.0:1789118154.518029:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789118154.518032:0:23377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21af2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.518038:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21af2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.518168:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21ae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f534 expref: 13 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.518201:0:23377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92600/0xaa253ed19be21af9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f534 expref: 12 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.518209:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff962b82d62900) 00010000:00010000:2.0:1789118154.518212:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789118154.518214:0:23377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92600, rc 0) 00000100:00100000:2.0:1789118154.518304:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+12:19043:x1876025572236544:12345-192.168.204.30@tcp:101:bash.0 Request processed in 852us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118154.518314:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 36 00000100:00100000:0.0:1789118154.525517:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.525707:0:23388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572236672 00000100:00100000:2.0:1789118154.525720:0:23388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572236672 00000100:00100000:2.0:1789118154.525796:0:23388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:2.0:1789118154.525807:0:23388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d29d87d8-e620-4bf4-8433-b91e751a0764+5:19043:x1876025572236672:12345-192.168.204.30@tcp:900:bash.0 00000100:00100000:2.0:1789118154.525940:0:23388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d29d87d8-e620-4bf4-8433-b91e751a0764+5:19043:x1876025572236672:12345-192.168.204.30@tcp:900:bash.0 Request processed in 134us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118154.525949:0:23388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:0.0:1789118154.529691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118154.529804:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572236928 00000100:00100000:3.0:1789118154.529821:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572236928 00000100:00100000:3.0:1789118154.529955:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:3.0:1789118154.529969:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+12:19043:x1876025572236928:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:3.0:1789118154.530025:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789118154.530098:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be21b00 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f53b expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.530242:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.530275:0:25722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21add lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f52d expref: 12 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.530285:0:25722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.530329:0:25722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21add lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f52d expref: 12 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118154.530659:0:25722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21add lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f52d expref: 12 pid: 25722 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789118154.530680:0:25722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25722:1876025593342848:192.168.204.30@tcp:104: 00000100:00100000:3.0:1789118154.530824:0:25722:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b86facf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789118154.533406:0:25722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd17840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25722:1876025593342848:192.168.204.30@tcp:104: 00010000:00010000:3.0:1789118154.533448:0:25722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118154.535861:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.536203:0:23363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572237056 00000100:00100000:2.0:1789118154.536223:0:23363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572237056 00010000:00010000:2.0:1789118154.536313:0:23363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21add lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f52d expref: 13 pid: 25722 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118154.536383:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 16 00000100:00100000:2.0:1789118154.536396:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+13:2406:x1876025572237056:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789118154.536420:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789118154.536429:0:23363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21add lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f52d expref: 13 pid: 25722 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.536472:0:23363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21add lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f52d expref: 13 pid: 25722 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.536512:0:23363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11400/0xaa253ed19be21add lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f52d expref: 13 pid: 25722 timeout: 906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.536537:0:23363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff962b82d62900) 00010000:00010000:2.0:1789118154.536544:0:23363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.536558:0:23363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.536569:0:23363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.536625:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789118154.536729:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+12:2406:x1876025572237056:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 334us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118154.536737:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 16 00010000:00010000:0.0:1789118154.537322:0:25722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.537336:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.537385:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5400/0xaa253ed19be21b0e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.537400:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5400/0xaa253ed19be21b0e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.537411:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5400/0xaa253ed19be21b0e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.538334:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5800/0xaa253ed19be21b15 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.538352:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5800/0xaa253ed19be21b15 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.538360:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5800/0xaa253ed19be21b15 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789118154.538376:0:25722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789118154.538410:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.538417:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.538444:0:25722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.538450:0:25722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962bbbc11e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789118154.538455:0:25722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.538464:0:25722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.538476:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff962b82d62900) 00010000:00010000:0.0:1789118154.538479:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789118154.538484:0:25722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.538490:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11e00/0xaa253ed19be21b07 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789118154.538507:0:25722:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000069260699 reply state 00000000749f0473 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5400/0xaa253ed19be21b0e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.538520:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5400/0xaa253ed19be21b0e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.538527:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff962b82d62f00) 00010000:00010000:0.0:1789118154.538529:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789118154.538532:0:25722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789118154.538586:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962bbbc11800/0xaa253ed19be21b00 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f53b expref: 15 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.538602:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5800/0xaa253ed19be21b15 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f53b expref: 14 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118154.538617:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:0.0:1789118154.538619:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789118154.538622:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f5800, rc 0) 00000100:00100000:0.0:1789118154.539740:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+15:19043:x1876025572236928:12345-192.168.204.30@tcp:101:bash.0 Request processed in 9763us (10058us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1789118154.539755:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 37 00000100:00100000:0.0:1789118154.552530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.552652:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572237184 00000100:00100000:2.0:1789118154.552668:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572237184 00000100:00100000:2.0:1789118154.552759:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:2.0:1789118154.552774:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+15:19043:x1876025572237184:12345-192.168.204.30@tcp:101:bash.0 00010000:00010000:2.0:1789118154.552811:0:23377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118154.552841:0:23377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b23 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f542 expref: -99 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.552971:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b2a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.552991:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b2a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.553005:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b2a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789118154.553126:0:23377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789118154.553131:0:23377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789118154.553158:0:23377:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b2a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.553171:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b2a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.553204:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b23 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f542 expref: 17 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.553227:0:23377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b2a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f542 expref: 16 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.553239:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:2.0:1789118154.553242:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789118154.553247:0:23377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93000, rc 0) 00000100:00100000:2.0:1789118154.553338:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+16:19043:x1876025572237184:12345-192.168.204.30@tcp:101:bash.0 Request processed in 568us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118154.553347:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 38 00000100:00100000:3.0:1789118154.556810:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118154.556944:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572237440 00000100:00100000:1.0:1789118154.556957:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572237440 00000100:00100000:1.0:1789118154.557038:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:1.0:1789118154.557095:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+16:19043:x1876025572237440:12345-192.168.204.30@tcp:35:bash.0 00000100:00100000:1.0:1789118154.557604:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+17:19043:x1876025572237440:12345-192.168.204.30@tcp:35:bash.0 Request processed in 553us (806us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1789118154.557615:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 5 00000100:00100000:0.0:1789118154.683006:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.683154:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572237696 00000100:00100000:2.0:1789118154.683168:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572237696 00000100:00100000:2.0:1789118154.683247:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:2.0:1789118154.683261:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+17:19053:x1876025572237696:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789118154.683304:0:23378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118154.683339:0:23378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f549 expref: -99 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789118154.683494:0:23378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789118154.683616:0:23378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f549 expref: 19 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.683632:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff962bae4aed00) 00010000:00010000:2.0:1789118154.683635:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789118154.683641:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f549 expref: 19 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.683657:0:23378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93600, rc 0) 00000100:00100000:2.0:1789118154.683738:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+18:19053:x1876025572237696:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 481us (749us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1789118154.683745:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 39 00000100:00100000:0.0:1789118154.687317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118154.687529:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572237952 00000100:00100000:1.0:1789118154.687542:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572237952 00000100:00100000:1.0:1789118154.687616:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:1.0:1789118154.687627:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+18:19053:x1876025572237952:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789118154.687916:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+19:19053:x1876025572237952:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 291us (676us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1789118154.687924:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 6 00000100:00100000:3.0:1789118154.740672:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.741035:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572238208 00000100:00100000:2.0:1789118154.741049:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572238208 00000100:00100000:2.0:1789118154.741176:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:2.0:1789118154.741188:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+19:19056:x1876025572238208:12345-192.168.204.30@tcp:101:lfs.0 00010000:00010000:2.0:1789118154.741223:0:23377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118154.741256:0:23377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b3f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f550 expref: -99 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.741466:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21b46 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.741483:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21b46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.741501:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21b46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789118154.741514:0:23377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789118154.741675:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b3f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f550 expref: 22 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.741699:0:23377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21b46 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f550 expref: 21 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.741710:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:2.0:1789118154.741714:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789118154.741719:0:23377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93400, rc 0) 00000100:00100000:2.0:1789118154.741952:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+21:19056:x1876025572238208:12345-192.168.204.30@tcp:101:lfs.0 Request processed in 765us (1294us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1789118154.741961:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 40 00000100:00100000:0.0:1789118154.750197:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.750568:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572238336 00000100:00100000:2.0:1789118154.750587:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572238336 00000100:00100000:2.0:1789118154.750674:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:2.0:1789118154.750687:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+21:19056:x1876025572238336:12345-192.168.204.30@tcp:54:lfs.0 00010000:00010000:2.0:1789118154.750801:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b54 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.750850:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.750869:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.750930:0:23378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.750939:0:23378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b54 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.750945:0:23378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b54 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.750952:0:23378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118154.750957:0:23378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b54 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.750966:0:23378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b54 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.750981:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:2.0:1789118154.750984:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789118154.750990:0:23378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b54 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.750996:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b54 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118154.751178:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+21:19056:x1876025572238336:12345-192.168.204.30@tcp:54:lfs.0 Request processed in 493us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118154.751196:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 41 00000100:00100000:0.0:1789118154.754171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.754499:0:26418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572238464 00000100:00100000:2.0:1789118154.754514:0:26418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572238464 00000100:00100000:2.0:1789118154.754618:0:26418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:2.0:1789118154.754631:0:26418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a885652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+21:2407:x1876025572238464:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789118154.754653:0:26418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789118154.754693:0:26418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21b46 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f550 expref: 21 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.754726:0:26418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:2.0:1789118154.754733:0:26418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789118154.754820:0:26418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a885652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+20:2407:x1876025572238464:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 192us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118154.754828:0:26418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:3.0:1789118154.757970:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118154.758097:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572238720 00000100:00100000:1.0:1789118154.758108:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572238720 00000100:00100000:1.0:1789118154.758173:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 7 00000100:00100000:1.0:1789118154.758194:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+20:19056:x1876025572238720:12345-192.168.204.30@tcp:35:lfs.0 00000100:00100000:1.0:1789118154.758859:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+21:19056:x1876025572238720:12345-192.168.204.30@tcp:35:lfs.0 Request processed in 662us (901us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1789118154.758869:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 7 00010000:00010000:3.0:1789118154.789863:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789118154.985941:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118154.986160:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572238976 00000100:00100000:1.0:1789118154.986178:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572238976 00000100:00100000:1.0:1789118154.986278:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:1.0:1789118154.986292:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88566940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+21:19087:x1876025572238976:12345-192.168.204.30@tcp:101:cat.0 00010000:00010000:1.0:1789118154.986348:0:23379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118154.986638:0:23379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be21b5b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f557 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.986828:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a800/0xaa253ed19be21b62 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.986851:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a800/0xaa253ed19be21b62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.986890:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a800/0xaa253ed19be21b62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789118154.986908:0:23379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789118154.987691:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b813db400/0xaa253ed19be21b5b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f557 expref: 24 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.987729:0:23379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a800/0xaa253ed19be21b62 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f557 expref: 23 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118154.987772:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:1.0:1789118154.987776:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789118154.987783:0:23379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9a800, rc 0) 00000100:00100000:1.0:1789118154.987921:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88566940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+23:19087:x1876025572238976:12345-192.168.204.30@tcp:101:cat.0 Request processed in 1629us (1995us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1789118154.987934:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 42 00000100:00100000:0.0:1789118154.993714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118154.993819:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572239232 00000100:00100000:1.0:1789118154.993833:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572239232 00000100:00100000:1.0:1789118154.993922:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:1.0:1789118154.993936:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88567c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+23:19087:x1876025572239232:12345-192.168.204.30@tcp:35:cat.0 00000100:00100000:1.0:1789118154.994389:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88567c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+24:19087:x1876025572239232:12345-192.168.204.30@tcp:35:cat.0 Request processed in 453us (688us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1789118154.994398:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 8 00000100:00100000:3.0:1789118154.996666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118154.996814:0:23363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572239360 00000100:00100000:2.0:1789118154.996828:0:23363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572239360 00000100:00100000:2.0:1789118154.996947:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:2.0:1789118154.996963:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd15e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+24:2405:x1876025572239360:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789118154.996988:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789118154.997035:0:23363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a800/0xaa253ed19be21b62 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f557 expref: 24 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118154.997124:0:23363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:2.0:1789118154.997134:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789118154.997228:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd15e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+23:2405:x1876025572239360:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 269us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118154.997267:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00000040:00080000:3.0:1789118155.045826:0:24138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789118155.065402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.071608:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572239616 00000100:00100000:2.0:1789118155.071638:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572239616 00000100:00100000:2.0:1789118155.071845:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:2.0:1789118155.071865:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+23:19093:x1876025572239616:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:2.0:1789118155.072101:0:23378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118155.072147:0:23378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21b70 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f55e expref: -99 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.072587:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b77 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.072608:0:23378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5800/0xaa253ed19be21b15 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f53b expref: 24 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.072619:0:23378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b2a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f542 expref: 24 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.072631:0:23378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b77 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.072686:0:23378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b2a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f542 expref: 24 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.072705:0:23378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b2a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f542 expref: 24 pid: 23377 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118155.072723:0:23378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23378:1876025593342976:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789118155.073019:0:23378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5800/0xaa253ed19be21b15 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f53b expref: 24 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.073031:0:23378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5800/0xaa253ed19be21b15 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f53b expref: 24 pid: 25722 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118155.073041:0:23378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfa87840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23378:1876025593343104:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789118155.073091:0:23378:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c640c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789118155.077933:0:23378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa85a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23378:1876025593342976:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789118155.077954:0:23378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfa87840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23378:1876025593343104:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789118155.077989:0:23378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b77 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118155.082948:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.083836:0:26418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572239744 00000100:00100000:2.0:1789118155.083864:0:26418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572239744 00010000:00010000:2.0:1789118155.083938:0:26418:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b2a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f542 expref: 25 pid: 23377 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118155.084003:0:26418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:2.0:1789118155.084016:0:26418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f45a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+25:2406:x1876025572239744:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789118155.084042:0:26418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789118155.084050:0:26418:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b2a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f542 expref: 25 pid: 23377 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.084105:0:26418:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b2a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f542 expref: 25 pid: 23377 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.084160:0:26418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b2a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f542 expref: 25 pid: 23377 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.084184:0:26418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:2.0:1789118155.084190:0:26418:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b77 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.084200:0:26418:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b77 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.084208:0:26418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789118155.084296:0:26418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f45a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+24:2406:x1876025572239744:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 282us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.084305:0:26418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 17 00000100:00100000:0.0:1789118155.085853:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.086131:0:23363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572239872 00000100:00100000:2.0:1789118155.086145:0:23363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572239872 00010000:00010000:2.0:1789118155.086204:0:23363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5800/0xaa253ed19be21b15 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f53b expref: 24 pid: 25722 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118155.086257:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 18 00000100:00100000:2.0:1789118155.086269:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba1a57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+24:2407:x1876025572239872:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789118155.086290:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789118155.086296:0:23363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5800/0xaa253ed19be21b15 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f53b expref: 24 pid: 25722 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.086314:0:23363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5800/0xaa253ed19be21b15 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f53b expref: 24 pid: 25722 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.086383:0:23363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5800/0xaa253ed19be21b15 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f53b expref: 24 pid: 25722 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.086407:0:23363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:2.0:1789118155.086415:0:23363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b77 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.086429:0:23363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b77 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.086440:0:23363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b77 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.086478:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789118155.086557:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba1a57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+23:2407:x1876025572239872:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 288us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.086566:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 18 00010000:00010000:0.0:1789118155.087033:0:23378:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b77 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.087045:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b77 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789118155.087105:0:23378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789118155.087333:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21b70 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f55e expref: 24 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.087353:0:23378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93600/0xaa253ed19be21b77 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f55e expref: 23 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.087376:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:0.0:1789118155.087380:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789118155.087383:0:23378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93600, rc 0) 00000100:00100000:0.0:1789118155.087445:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+23:19093:x1876025572239616:12345-192.168.204.30@tcp:101:dd.0 Request processed in 15586us (22061us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1789118155.087453:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 43 00000100:00100000:0.0:1789118155.094396:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.094521:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572240000 00000100:00100000:2.0:1789118155.094544:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572240000 00000100:00100000:2.0:1789118155.094668:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:2.0:1789118155.094688:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+23:19093:x1876025572240000:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:2.0:1789118155.094738:0:23377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118155.094782:0:23377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b85 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f565 expref: -99 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.094851:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21b8c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.094908:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21b8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.094923:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21b8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.095155:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21b85 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f565 expref: 25 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.095178:0:23377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21b8c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f565 expref: 24 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.095188:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:2.0:1789118155.095191:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789118155.095197:0:23377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d92000, rc 0) 00000100:00100000:2.0:1789118155.095280:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+24:19093:x1876025572240000:12345-192.168.204.30@tcp:101:dd.0 Request processed in 600us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.095289:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 44 00000100:00100000:3.0:1789118155.105545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118155.105834:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572240256 00000100:00100000:0.0:1789118155.105849:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572240256 00000100:00100000:0.0:1789118155.105947:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 45 00000100:00100000:0.0:1789118155.105960:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+24:19093:x1876025572240256:12345-192.168.204.30@tcp:36:dd.0 00010000:00010000:0.0:1789118155.106519:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4a00/0xaa253ed19be21b93 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.106545:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4a00/0xaa253ed19be21b93 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.106561:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4a00/0xaa253ed19be21b93 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789118155.106626:0:25722:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1789118155.106657:0:25722:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002efd9500 reply state 000000009acb124d transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4a00/0xaa253ed19be21b93 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.106673:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4a00/0xaa253ed19be21b93 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.106683:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:0.0:1789118155.106706:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789118155.106713:0:25722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789118155.106864:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+27:19093:x1876025572240256:12345-192.168.204.30@tcp:36:dd.0 Request processed in 903us (1335us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1789118155.106873:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 45 00000020:00080000:0.0:1789118155.106888:0:25722:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789118155.118292:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118155.118431:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572240384 00000100:00100000:0.0:1789118155.118450:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572240384 00000100:00100000:0.0:1789118155.118559:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:0.0:1789118155.119032:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf725e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+27:19093:x1876025572240384:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:0.0:1789118155.119091:0:23377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789118155.119128:0:23377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5600/0xaa253ed19be21b9a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f56c expref: -99 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.119239:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5600/0xaa253ed19be21b9a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f56c expref: 28 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.119266:0:23377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5600/0xaa253ed19be21b9a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f56c expref: 28 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.119303:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:0.0:1789118155.119309:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789118155.119317:0:23377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f5600, rc 0) 00000100:00100000:0.0:1789118155.119447:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf725e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+28:19093:x1876025572240384:12345-192.168.204.30@tcp:101:dd.0 Request processed in 423us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118155.121131:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 46 00000100:00100000:1.0:1789118155.152476:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.152622:0:26418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572240640 00000100:00100000:2.0:1789118155.152635:0:26418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572240640 00000100:00100000:2.0:1789118155.152766:0:26418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:2.0:1789118155.152781:0:26418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+28:19093:x1876025572240640:12345-192.168.204.30@tcp:103:dd.0 00010000:00010000:2.0:1789118155.152803:0:26418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789118155.152838:0:26418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5600/0xaa253ed19be21b9a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f56c expref: 28 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.152864:0:26418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:2.0:1789118155.152901:0:26418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789118155.153000:0:26418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+27:19093:x1876025572240640:12345-192.168.204.30@tcp:103:dd.0 Request processed in 222us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.153008:0:26418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 2 00000100:00100000:3.0:1789118155.167617:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118155.169115:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572240768 00000100:00100000:1.0:1789118155.169134:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572240768 00000100:00100000:1.0:1789118155.169237:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:1.0:1789118155.169251:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+27:19093:x1876025572240768:12345-192.168.204.30@tcp:58:dd.0 00010000:00010000:1.0:1789118155.169402:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be21ba1 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.169426:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be21ba1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.169441:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be21ba1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789118155.171337:0:25722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789118155.171391:0:25722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1789118155.171580:0:25722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1789118155.171731:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+27:19093:x1876025572240768:12345-192.168.204.30@tcp:58:dd.0 Request processed in 2466us (4118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118155.171744:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 47 00000100:00100000:0.0:1789118155.176683:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118155.177035:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572240896 00000100:00100000:1.0:1789118155.177102:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572240896 00000100:00100000:1.0:1789118155.177186:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 48 00000100:00100000:1.0:1789118155.177199:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+27:19093:x1876025572240896:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:1.0:1789118155.177225:0:23379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118155.177252:0:23379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a000/0xaa253ed19be21ba8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f573 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.177326:0:23379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be21ba1 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.177339:0:23379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a000/0xaa253ed19be21ba8 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f573 expref: 28 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.177379:0:23379:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be21ba1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.177395:0:23379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a000/0xaa253ed19be21ba8 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f573 expref: 28 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.177412:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:1.0:1789118155.177432:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789118155.177437:0:23379:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a000/0xaa253ed19be21ba8 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f573 expref: 28 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.177446:0:23379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9a000, rc 0) 00000100:00100000:1.0:1789118155.177525:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+28:19093:x1876025572240896:12345-192.168.204.30@tcp:101:dd.0 Request processed in 327us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118155.177533:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 48 00000040:00080000:1.0:1789118155.429465:0:23413:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789118155.429480:0:23413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789118155.429535:0:23413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789118155.429550:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789118155.429769:0:23413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23413:1876025593343232:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789118155.430241:0:23413:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8ef88900 going to sleep for 11 seconds 00000100:00100000:3.0:1789118155.458848:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.459593:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572241024 00000100:00100000:2.0:1789118155.459604:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572241024 00000100:00100000:1.0:1789118155.459623:0:23413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbf727840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23413:1876025593343232:192.168.204.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789118155.459761:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:2.0:1789118155.459776:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+28:19095:x1876025572241024:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789118155.459834:0:23378:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789118155.460088:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+28:19095:x1876025572241024:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 313us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.460097:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 49 00000100:00100000:0.0:1789118155.472225:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118155.472504:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572241152 00000100:00100000:1.0:1789118155.472518:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572241152 00000100:00100000:1.0:1789118155.472602:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:1.0:1789118155.472616:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87f45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+28:19095:x1876025572241152:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789118155.472757:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b000/0xaa253ed19be21baf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.473460:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b000/0xaa253ed19be21baf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.473484:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b000/0xaa253ed19be21baf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.476792:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bb6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.476821:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.476835:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.476884:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bbd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.476896:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.476904:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789118155.476975:0:23379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789118155.476984:0:23379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789118155.476999:0:23379:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477010:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b000/0xaa253ed19be21baf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477015:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b000/0xaa253ed19be21baf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477021:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b000/0xaa253ed19be21baf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477045:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9b000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789118155.477049:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b000/0xaa253ed19be21baf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477796:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b000/0xaa253ed19be21baf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477811:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962b832cca00) 00010000:00010000:1.0:1789118155.477814:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789118155.477818:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b000/0xaa253ed19be21baf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477824:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b000/0xaa253ed19be21baf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477840:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477845:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477851:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477855:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9a600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789118155.477859:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477864:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477950:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff962b95eadc00) 00010000:00010000:1.0:1789118155.477953:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789118155.477956:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bb6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477962:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bb6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477978:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477983:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bbd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477988:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bbd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477992:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9aa00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789118155.477994:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bbd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.477999:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bbd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.478006:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:1.0:1789118155.478008:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789118155.478010:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bbd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.478015:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bbd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118155.478455:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87f45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+28:19095:x1876025572241152:12345-192.168.204.30@tcp:34:lhsmtool_posix.0 Request processed in 5830us (6237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118155.478466:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 50 00000100:00100000:1.0:1789118155.485820:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118155.488692:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572241408 00000100:00100000:0.0:1789118155.488710:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572241408 00000100:00100000:0.0:1789118155.488802:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:0.0:1789118155.488814:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf727840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+28:19095:x1876025572241408:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789118155.488845:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789118155.488884:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4c00/0xaa253ed19be21bc4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f57a expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.489047:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21bcb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.489116:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21bcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.489130:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21bcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789118155.489143:0:25722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789118155.496339:0:25722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21bcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.496357:0:25722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21bcb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.496364:0:25722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21bcb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.496371:0:25722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f5c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789118155.496375:0:25722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21bcb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.496383:0:25722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21bcb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.496399:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:1.0:1789118155.496402:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789118155.496416:0:25722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21bcb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.496423:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21bcb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.496479:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4c00/0xaa253ed19be21bc4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f57a expref: 30 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.496507:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff962b832cca00) 00010000:00010000:1.0:1789118155.496509:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789118155.496513:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4c00/0xaa253ed19be21bc4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f57a expref: 30 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.496522:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a887f4c00, rc 0) 00000100:00100000:1.0:1789118155.496610:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf727840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+29:19095:x1876025572241408:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 7798us (10800us total) trans 12884901907 rc 301/301 00000100:00100000:1.0:1789118155.496620:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 51 00000100:00100000:0.0:1789118155.504638:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.504767:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572241536 00000100:00100000:2.0:1789118155.504782:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572241536 00000100:00100000:2.0:1789118155.505048:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:2.0:1789118155.505116:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+29:19095:x1876025572241536:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789118155.505169:0:23377:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789118155.505336:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+29:19095:x1876025572241536:12345-192.168.204.30@tcp:53:lhsmtool_posix.0 Request processed in 223us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.505358:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 52 00000100:00100000:2.0:1789118155.510596:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118155.515532:0:23378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572241792 00000100:00100000:0.0:1789118155.515555:0:23378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572241792 00000100:00100000:2.0:1789118155.518649:0:23378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:2.0:1789118155.518675:0:23378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+29:19095:x1876025572241792:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789118155.518713:0:23378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118155.518753:0:23378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21bd9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f581 expref: -99 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789118155.521042:0:23378:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =59 00000004:00080000:2.0:1789118155.521097:0:23378:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+59 in llog 00000004:00080000:2.0:1789118155.521131:0:23378:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1789118155.521626:0:23378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21be0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.521650:0:23378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21be0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.521666:0:23378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21be0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.521755:0:23378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21bd9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f581 expref: 32 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.521775:0:23378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21be0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f581 expref: 31 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.521784:0:23378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff962b832ccc00) 00010000:00010000:2.0:1789118155.521788:0:23378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789118155.521792:0:23378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93400, rc 0) 00000100:00100000:2.0:1789118155.521910:0:23378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+31:19095:x1876025572241792:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 3243us (11331us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1789118155.521921:0:23378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 53 00000100:00100000:0.0:1789118155.544423:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118155.545256:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572242048 00000100:00100000:1.0:1789118155.545272:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572242048 00000100:00100000:1.0:1789118155.545485:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:1.0:1789118155.545498:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0719e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+31:19095:x1876025572242048:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789118155.545586:0:23379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789118155.545631:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93400/0xaa253ed19be21be0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f581 expref: 31 pid: 23378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.545660:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff962b832ccc00) 00010000:00010000:1.0:1789118155.545678:0:23379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789118155.545718:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bee lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.545737:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bee lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.545750:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bee lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546525:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bf5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xef48673e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546542:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bf5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xef48673e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546551:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bf5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xef48673e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546626:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bee lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546634:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bee lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546641:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bee lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546648:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9aa00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789118155.546654:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bee lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546663:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bee lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546674:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff962b82d62900) 00010000:00010000:1.0:1789118155.546677:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789118155.546682:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bee lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546688:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21bee lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546714:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bf5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xef48673e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546720:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bf5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xef48673e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546725:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bf5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xef48673e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546730:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9a600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789118155.546733:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bf5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xef48673e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546739:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bf5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xef48673e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546747:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xef48673e (ffff962b95eadc00) 00010000:00010000:1.0:1789118155.546749:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789118155.546751:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bf5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xef48673e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.546757:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bf5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xef48673e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118155.548665:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0719e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+30:19095:x1876025572242048:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 3153us (4309us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789118155.548681:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 54 00000100:00100000:0.0:1789118155.565612:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118155.565845:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572242176 00000100:00100000:1.0:1789118155.565862:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572242176 00000100:00100000:1.0:1789118155.565962:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 55 00000100:00100000:1.0:1789118155.565996:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+30:19095:x1876025572242176:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789118155.566025:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118155.566075:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bfc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f588 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.566127:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21c03 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.566144:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21c03 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.566157:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21c03 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.566304:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21bfc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f588 expref: 32 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.566323:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9aa00/0xaa253ed19be21c03 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f588 expref: 31 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.566332:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff962b95eadc00) 00010000:00010000:1.0:1789118155.566348:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789118155.566453:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9aa00, rc 0) 00000100:00100000:1.0:1789118155.566530:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+31:19095:x1876025572242176:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 536us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118155.566539:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 55 00000100:00100000:3.0:1789118155.572703:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.573133:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572242432 00000100:00100000:2.0:1789118155.573155:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572242432 00000100:00100000:2.0:1789118155.573260:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:2.0:1789118155.573274:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+31:19095:x1876025572242432:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789118155.573589:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21c0a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.573614:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21c0a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.573631:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21c0a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789118155.573933:0:23377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:2.0:1789118155.573945:0:23377:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 807856890139ns, next at 808856886762ns, rc = 0 00000004:00010000:2.0:1789118155.574014:0:23377:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002d5286a6 reply state 00000000a8d85557 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21c0a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.574030:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21c0a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.574039:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff962b95eadc00) 00010000:00010000:2.0:1789118155.574042:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789118155.574047:0:23377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789118155.574268:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+33:19095:x1876025572242432:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 994us (1579us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1789118155.574278:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 56 00000100:00100000:0.0:1789118155.578925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118155.579106:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572242560 00000100:00100000:1.0:1789118155.579124:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572242560 00000100:00100000:1.0:1789118155.579223:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:1.0:1789118155.579257:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+33:19095:x1876025572242560:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789118155.579314:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118155.579368:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21c11 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f58f expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.579474:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21c11 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f58f expref: 34 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.579493:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21c11 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f58f expref: 34 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.579518:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff962b95eadc00) 00010000:00010000:1.0:1789118155.579522:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789118155.579527:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9a600, rc 0) 00000100:00100000:1.0:1789118155.579622:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+34:19095:x1876025572242560:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 368us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118155.579631:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 57 00000100:00100000:0.0:1789118155.594324:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118155.594652:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572242688 00000100:00100000:1.0:1789118155.594666:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572242688 00000100:00100000:1.0:1789118155.594773:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00100000:1.0:1789118155.594787:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+5:2406:x1876025572242688:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789118155.595272:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+6:2406:x1876025572242688:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 487us (976us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1789118155.595283:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 25 00000100:00080000:3.0:1789118155.603210:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789118155.603282:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.603470:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572242944 00000100:00100000:2.0:1789118155.603487:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572242944 00000100:00100000:2.0:1789118155.603573:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:2.0:1789118155.603587:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+34:19095:x1876025572242944:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789118155.603958:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+35:19095:x1876025572242944:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 373us (683us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1789118155.603987:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 9 00000100:00100000:2.0:1789118155.607096:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118155.607208:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572243200 00000100:00100000:1.0:1789118155.607220:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572243200 00000100:00100000:1.0:1789118155.607330:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:1.0:1789118155.607343:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+35:19095:x1876025572243200:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789118155.607620:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+35:19095:x1876025572243200:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 279us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118155.607629:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 58 00000100:00100000:0.0:1789118155.615472:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118155.618314:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572243328 00000100:00100000:1.0:1789118155.618345:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572243328 00000100:00100000:1.0:1789118155.618488:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:1.0:1789118155.618503:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+35:19095:x1876025572243328:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789118155.618536:0:25722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118155.618575:0:25722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b000/0xaa253ed19be21c18 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f596 expref: -99 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.618710:0:25722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a400/0xaa253ed19be21c1f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.618733:0:25722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a400/0xaa253ed19be21c1f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.618750:0:25722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a400/0xaa253ed19be21c1f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789118155.618830:0:25722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789118155.618862:0:25722:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a400/0xaa253ed19be21c1f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.618915:0:25722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b000/0xaa253ed19be21c18 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f596 expref: 37 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.618978:0:25722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a400/0xaa253ed19be21c1f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f596 expref: 36 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.618991:0:25722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff962b95eadc00) 00010000:00010000:1.0:1789118155.618996:0:25722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789118155.619002:0:25722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9a400, rc 0) 00000100:00100000:1.0:1789118155.619236:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+36:19095:x1876025572243328:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 734us (3856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118155.619248:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 59 00000100:00100000:0.0:1789118155.620848:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118155.621020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118155.621108:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118155.621145:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118155.621166:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118155.621187:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118155.621213:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.621622:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572243712 00000100:00100000:2.0:1789118155.621638:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572243712 00000100:00100000:2.0:1789118155.621725:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572244224 00000100:00100000:2.0:1789118155.621728:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572244224 00000100:00100000:2.0:1789118155.621751:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572244096 00000100:00100000:2.0:1789118155.621754:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572244096 00000100:00100000:2.0:1789118155.621773:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:2.0:1789118155.621783:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba07183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+5:2407:x1876025572243712:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789118155.621891:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba07183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+5:2407:x1876025572243712:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 109us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.621899:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:2.0:1789118155.621917:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:2.0:1789118155.621924:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0719a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:2407:x1876025572244224:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789118155.621947:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0719a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:2407:x1876025572244224:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 25us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.621953:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:2.0:1789118155.621962:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:2.0:1789118155.621967:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba07192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:2407:x1876025572244096:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789118155.621988:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba07192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:2407:x1876025572244096:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 21us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.621993:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 22 00000100:00100000:2.0:1789118155.622018:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572243968 00000100:00100000:2.0:1789118155.622037:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572243968 00000100:00100000:2.0:1789118155.622101:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572243584 00000100:00100000:2.0:1789118155.622106:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572243584 00000100:00100000:2.0:1789118155.622118:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572243840 00000100:00100000:2.0:1789118155.622121:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572243840 00000100:00100000:2.0:1789118155.622133:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:2.0:1789118155.622139:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:2407:x1876025572243968:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789118155.622173:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+5:2407:x1876025572243968:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 34us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.622179:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:2.0:1789118155.622189:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:2.0:1789118155.622195:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+5:2407:x1876025572243584:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789118155.622221:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+5:2407:x1876025572243584:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 26us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.622227:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:2.0:1789118155.622238:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:2.0:1789118155.622244:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+12:2407:x1876025572243840:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:2.0:1789118155.622276:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111424fa-fdc1-423c-8b6a-bf4f0cc9baf9+12:2407:x1876025572243840:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 32us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.622282:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:3.0:1789118155.622518:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572243456 00000100:00100000:3.0:1789118155.622524:0:23372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572243456 00000100:00100000:3.0:1789118155.622565:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 168 00000100:00100000:3.0:1789118155.622573:0:23372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+13:2407:x1876025572243456:12345-192.168.204.30@tcp:400:kworker.0 00000100:00100000:3.0:1789118155.622607:0:23372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94fd0678-a106-4c9c-9081-e19ef8362a30+13:2407:x1876025572243456:12345-192.168.204.30@tcp:400:kworker.0 Request processed in 35us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118155.622614:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 168 00000100:00080000:0.0:1789118155.622725:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789118155.622731:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789118155.631158:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.631312:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572244352 00000100:00100000:2.0:1789118155.631327:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572244352 00000100:00100000:2.0:1789118155.631418:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:2.0:1789118155.631432:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+6:2406:x1876025572244352:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789118155.631464:0:24890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789118155.631521:0:24890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079d9f570/0xaa253ed19be21c26 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f59d expref: -99 pid: 24890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789118155.631562:0:24890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3c6cc, blocks: 0x0 00010000:00010000:2.0:1789118155.631596:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=807s v=(0 0) 00010000:00010000:2.0:1789118155.631603:0:24890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118155.631617:0:24890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079d9f570/0xaa253ed19be21c26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f59d expref: 7 pid: 24890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.631649:0:24890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000079d9f570/0xaa253ed19be21c26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f59d expref: 7 pid: 24890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.631669:0:24890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962a87d93400, rc 0) 00000100:00100000:2.0:1789118155.631747:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+7:2406:x1876025572244352:12345-192.168.204.30@tcp:101:lhsmtool_posix.0 Request processed in 318us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.631755:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 26 00000100:00100000:2.0:1789118155.642586:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118155.642717:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572244608 00000100:00100000:0.0:1789118155.642730:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572244608 00000100:00100000:0.0:1789118155.642815:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:0.0:1789118155.642827:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+36:19095:x1876025572244608:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789118155.643009:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+36:19095:x1876025572244608:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 184us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118155.643017:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 60 00000100:00100000:1.0:1789118155.648704:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.648827:0:25722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572244736 00000100:00100000:2.0:1789118155.648841:0:25722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572244736 00000100:00100000:2.0:1789118155.648932:0:25722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 61 00000100:00100000:2.0:1789118155.648945:0:25722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbf7243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+36:19095:x1876025572244736:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789118155.650807:0:23357:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1789118155.650832:0:23357:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789118155.651044:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651113:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651122:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651141:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d92c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118155.651148:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651160:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651182:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff962b832cc100) 00010000:00010000:2.0:1789118155.651185:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789118155.651192:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a19 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651200:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92c00/0xaa253ed19be21a19 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651229:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4600/0xaa253ed19be21a20 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651235:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4600/0xaa253ed19be21a20 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651242:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4600/0xaa253ed19be21a20 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651247:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f4600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118155.651250:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4600/0xaa253ed19be21a20 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651257:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4600/0xaa253ed19be21a20 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651276:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff962b82d62900) 00010000:00010000:2.0:1789118155.651278:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789118155.651282:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4600/0xaa253ed19be21a20 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651288:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4600/0xaa253ed19be21a20 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651306:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5400/0xaa253ed19be21b0e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651312:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5400/0xaa253ed19be21b0e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651318:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5400/0xaa253ed19be21b0e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651323:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f5400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118155.651326:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5400/0xaa253ed19be21b0e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651332:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5400/0xaa253ed19be21b0e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651339:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff962b82d62f00) 00010000:00010000:2.0:1789118155.651342:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789118155.651345:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5400/0xaa253ed19be21b0e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651361:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5400/0xaa253ed19be21b0e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651391:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4a00/0xaa253ed19be21b93 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651398:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4a00/0xaa253ed19be21b93 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651403:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4a00/0xaa253ed19be21b93 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651408:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f4a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118155.651411:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4a00/0xaa253ed19be21b93 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651417:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4a00/0xaa253ed19be21b93 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651426:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:2.0:1789118155.651429:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789118155.651432:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4a00/0xaa253ed19be21b93 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651438:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4a00/0xaa253ed19be21b93 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651450:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21c0a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651456:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21c0a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651461:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21c0a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651472:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118155.651475:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21c0a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651482:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21c0a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651492:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff962b95eadc00) 00010000:00010000:2.0:1789118155.651494:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789118155.651498:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21c0a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.651504:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93000/0xaa253ed19be21c0a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118155.653151:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789118155.653187:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a85fc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593343360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789118155.653296:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118155.653400:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593343360 00000100:00100000:0.0:1789118155.653412:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593343360 00000100:00100000:0.0:1789118155.653493:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789118155.653504:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593343360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789118155.653699:0:24891:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789118155.653704:0:24891:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789118155.653706:0:24891:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789118155.653709:0:24891:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789118156 -> 1789118156 00002000:00010000:0.0:1789118155.653712:0:24891:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789118155.653769:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876025593343360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 265us (472us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1789118155.653792:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789118155.653829:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789118155.653886:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff962a85fc9a40/2, rc 0, transno 12884901892 00000100:00100000:0.0:1789118155.653894:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a85fc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593343360:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1789118155.654171:0:23357:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:2.0:1789118155.654736:0:25722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbf7243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+15:19095:x1876025572244736:12345-192.168.204.30@tcp:44:lhsmtool_posix.0 Request processed in 5787us (6042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.654750:0:25722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 61 00010000:00010000:1.0:1789118155.655626:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93a00/0xaa253ed19be21ab3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.655649:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93a00/0xaa253ed19be21ab3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.655659:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93a00/0xaa253ed19be21ab3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.655668:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a87d93a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1789118155.655674:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93a00/0xaa253ed19be21ab3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.655683:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93a00/0xaa253ed19be21ab3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.655709:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff962b82d62900) 00010000:00010000:1.0:1789118155.655713:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789118155.655742:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93a00/0xaa253ed19be21ab3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.655750:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d93a00/0xaa253ed19be21ab3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118155.659294:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:3.0:1789118155.659455:0:25928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572244864 00000100:00100000:3.0:1789118155.659470:0:25928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572244864 00000100:00100000:3.0:1789118155.659550:0:25928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:3.0:1789118155.659563:0:25928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a85fcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d29d87d8-e620-4bf4-8433-b91e751a0764+7:2406:x1876025572244864:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789118155.659749:0:25928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a85fcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d29d87d8-e620-4bf4-8433-b91e751a0764+7:2406:x1876025572244864:12345-192.168.204.30@tcp:16:lhsmtool_posix.0 Request processed in 189us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118155.659759:0:25928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 28 00000100:00100000:2.0:1789118155.665735:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118155.666488:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572245120 00000100:00100000:1.0:1789118155.666508:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572245120 00000100:00100000:1.0:1789118155.666609:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:1.0:1789118155.666626:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfa84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+15:19095:x1876025572245120:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789118155.666750:0:23377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789118155.666800:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a400/0xaa253ed19be21c1f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f596 expref: 15 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.666835:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff962b95eadc00) 00010000:00010000:1.0:1789118155.666846:0:23377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789118155.666911:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9be00/0xaa253ed19be21c2d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.666931:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9be00/0xaa253ed19be21c2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.666945:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9be00/0xaa253ed19be21c2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789118155.667189:0:23377:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004dc388c7 reply state 000000000cf0b279 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9be00/0xaa253ed19be21c2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.667208:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9be00/0xaa253ed19be21c2d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.667237:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff962b95eadc00) 00010000:00010000:1.0:1789118155.667240:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789118155.667244:0:23377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789118155.667501:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfa84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+16:19095:x1876025572245120:12345-192.168.204.30@tcp:36:lhsmtool_posix.0 Request processed in 876us (1788us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1789118155.667512:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 62 00000100:00100000:0.0:1789118155.671170:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.672282:0:24892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572245248 00000100:00100000:2.0:1789118155.672306:0:24892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572245248 00000100:00100000:2.0:1789118155.672427:0:24892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:2.0:1789118155.672442:0:24892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba071a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+7:2404:x1876025572245248:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789118155.672692:0:24892:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789118155.672703:0:24892:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789118155 00002000:00010000:2.0:1789118155.672706:0:24892:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789118155 00002000:00010000:2.0:1789118155.672709:0:24892:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789118156 -> 1789118155 00002000:00010000:2.0:1789118155.672712:0:24892:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789118155.672854:0:24892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba071a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+8:2404:x1876025572245248:12345-192.168.204.30@tcp:2:lhsmtool_posix.0 Request processed in 415us (1698us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1789118155.672864:0:24892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 29 00000100:00100000:3.0:1789118155.676240:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118155.676543:0:25927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572245376 00000100:00100000:0.0:1789118155.676555:0:25927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572245376 00000100:00100000:0.0:1789118155.676627:0:25927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:0.0:1789118155.676639:0:25927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+8:2406:x1876025572245376:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789118155.676703:0:25927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006f46740e/0xaa253ed19be21c34 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.676728:0:25927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789118155.676734:0:25927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789118155.676742:0:25927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f46740e/0xaa253ed19be21c34 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.676757:0:25927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f46740e/0xaa253ed19be21c34 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.676788:0:25927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006f46740e/0xaa253ed19be21c34 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.676795:0:25927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f46740e/0xaa253ed19be21c34 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.676840:0:25927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f46740e/0xaa253ed19be21c34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.676848:0:25927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f5c00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:0.0:1789118155.676852:0:25927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f46740e/0xaa253ed19be21c34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.676862:0:25927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f46740e/0xaa253ed19be21c34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.676892:0:25927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f46740e/0xaa253ed19be21c34 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.676899:0:25927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f46740e/0xaa253ed19be21c34 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118155.676990:0:25927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+8:2406:x1876025572245376:12345-192.168.204.30@tcp:1:lhsmtool_posix.0 Request processed in 352us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118155.676999:0:25927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 30 00000100:00100000:3.0:1789118155.686966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118155.687132:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572245632 00000100:00100000:1.0:1789118155.687151:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572245632 00000100:00100000:0.0:1789118155.687266:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 63 00000100:00100000:0.0:1789118155.687279:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+16:19095:x1876025572245632:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789118155.687376:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.687393:0:23379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21b8c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f565 expref: 16 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.687409:0:23379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.687444:0:23379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21b8c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f565 expref: 16 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.687458:0:23379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21b8c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f565 expref: 16 pid: 23377 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118155.687472:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23379:1876025593343488:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789118155.687568:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b886050c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789118155.697529:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.697703:0:23363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572245760 00000100:00100000:2.0:1789118155.697716:0:23363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572245760 00010000:00010000:2.0:1789118155.697779:0:23363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21b8c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f565 expref: 17 pid: 23377 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118155.697831:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 19 00000100:00100000:2.0:1789118155.697844:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a85fc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+17:2406:x1876025572245760:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789118155.697864:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789118155.697883:0:23363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21b8c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f565 expref: 17 pid: 23377 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.697909:0:23363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21b8c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f565 expref: 17 pid: 23377 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.697942:0:23363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:2.0:1789118155.697951:0:23363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a000/0xaa253ed19be21ba8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f573 expref: 17 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.697963:0:23363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.697972:0:23363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.697980:0:23363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.698023:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789118155.698146:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a85fc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+17:2406:x1876025572245760:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 305us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.698156:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 19 00010000:00010000:0.0:1789118155.699548:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a87d92000/0xaa253ed19be21b8c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f565 expref: 16 pid: 23377 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118155.699580:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23379:1876025593343488:192.168.204.30@tcp:104: 00010000:00010000:0.0:1789118155.699614:0:23379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.699625:0:23379:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.699631:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.699903:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.699918:0:23379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21c11 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f58f expref: 16 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.699934:0:23379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.699970:0:23379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21c11 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f58f expref: 16 pid: 25722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.699986:0:23379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21c11 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f58f expref: 16 pid: 25722 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118155.700000:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23379:1876025593343616:192.168.204.30@tcp:104: 00000100:00100000:0.0:1789118155.700184:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b88605a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789118155.709475:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.709582:0:23362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572245888 00000100:00100000:2.0:1789118155.709602:0:23362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572245888 00010000:00010000:2.0:1789118155.709679:0:23362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21c11 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f58f expref: 17 pid: 25722 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118155.709761:0:23362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 20 00000100:00100000:2.0:1789118155.709778:0:23362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a85fca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+17:2407:x1876025572245888:12345-192.168.204.30@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789118155.709795:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23379:1876025593343616:192.168.204.30@tcp:104: 00010000:00010000:2.0:1789118155.709803:0:23362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789118155.709817:0:23362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21c11 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f58f expref: 17 pid: 25722 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.709836:0:23362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21c11 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f58f expref: 17 pid: 25722 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.712327:0:23379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.712449:0:23362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a600/0xaa253ed19be21c11 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f58f expref: 17 pid: 25722 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.712483:0:23362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff962b95eadc00) 00010000:00010000:2.0:1789118155.712490:0:23362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.712504:0:23362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.712545:0:23362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.717523:0:23362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789118155.717650:0:23362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a85fca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+16:2407:x1876025572245888:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 7866us (8173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.717668:0:23362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 20 00010000:00010000:0.0:1789118155.718525:0:23379:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.718548:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789118155.718804:0:23379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1789118155.719020:0:23379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1789118155.719088:0:23379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1789118155.722096:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23379:1876025593343744:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789118155.722504:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118155.722549:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff962b8e9e1540 going to sleep for 11 seconds 00000100:00100000:3.0:1789118155.722625:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593343744 00000100:00100000:3.0:1789118155.722643:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593343744 00000100:00100000:3.0:1789118155.722744:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789118155.722757:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86a6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23379:x1876025593343744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789118155.722955:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86a6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23379:x1876025593343744:12345-0@lo:1000:mdt00_002.0 Request processed in 200us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118155.722965:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789118155.723266:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23379:1876025593343744:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789118155.723540:0:23379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1789118155.723639:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962ba0719680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23379:1876025593343872:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789118155.723695:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118155.723730:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789118155.723770:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593343872 00000100:00100000:0.0:1789118155.723782:0:24121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593343872 00000100:00100000:0.0:1789118155.723853:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789118155.723865:0:24121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23379:x1876025593343872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789118155.725269:0:24121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:23379:x1876025593343872:12345-0@lo:1000:mdt00_002.0 Request processed in 1402us (1569us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1789118155.725280:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789118155.725508:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962ba0719680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23379:1876025593343872:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789118155.725559:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.725568:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.725575:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.725583:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f4200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118155.725588:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.725596:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.726034:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff962b95eadc00) 00010000:00010000:2.0:1789118155.726039:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789118155.726046:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.726501:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4200/0xaa253ed19be21c42 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.726548:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be21ba1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.726556:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be21ba1 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.726562:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be21ba1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.726567:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962baea9ba00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1789118155.726571:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be21ba1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.726578:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be21ba1 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.726591:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:2.0:1789118155.726593:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789118155.726602:0:23379:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a000/0xaa253ed19be21ba8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f573 expref: 19 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.726613:0:23379:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a000/0xaa253ed19be21ba8 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f573 expref: 19 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.726750:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a000/0xaa253ed19be21ba8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f573 expref: 19 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.726842:0:23379:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9a000/0xaa253ed19be21ba8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f573 expref: 19 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118155.726860:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6da40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23379:1876025593344000:192.168.204.30@tcp:105: 00000100:00100000:2.0:1789118155.727120:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64900 going to sleep for 11 seconds 00000100:00100000:1.0:1789118155.738514:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118155.740173:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6da40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23379:1876025593344000:192.168.204.30@tcp:105: 00010000:00010000:0.0:1789118155.740210:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be21ba1 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740223:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9ba00/0xaa253ed19be21ba1 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740262:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4e00/0xaa253ed19be21c49 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740277:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4e00/0xaa253ed19be21c49 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740289:0:23379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4e00/0xaa253ed19be21c49 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740313:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4e00/0xaa253ed19be21c49 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740320:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4e00/0xaa253ed19be21c49 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740327:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4e00/0xaa253ed19be21c49 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740332:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f4e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789118155.740336:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4e00/0xaa253ed19be21c49 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740357:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4e00/0xaa253ed19be21c49 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740371:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:0.0:1789118155.740374:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789118155.740378:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4e00/0xaa253ed19be21c49 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740385:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f4e00/0xaa253ed19be21c49 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740395:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740401:0:23379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740407:0:23379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740412:0:23379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962a887f5c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1789118155.740415:0:23379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740420:0:23379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740427:0:23379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:0.0:1789118155.740429:0:23379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789118155.740431:0:23379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789118155.740446:0:23379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962a887f5c00/0xaa253ed19be21c3b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789118155.740638:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29d87d8-e620-4bf4-8433-b91e751a0764+19:19095:x1876025572245632:12345-192.168.204.30@tcp:57:lhsmtool_posix.0 Request processed in 53360us (53680us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1789118155.740650:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 63 00000020:00080000:0.0:1789118155.740661:0:23379:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789118155.740726:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572246016 00000100:00100000:2.0:1789118155.740737:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572246016 00000100:00100000:2.0:1789118155.740808:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:2.0:1789118155.740819:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87d79450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+19:19093:x1876025572246016:12345-192.168.204.30@tcp:49:dd.0 00000040:00080000:1.0:1789118155.740925:0:23413:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789118155.740930:0:23413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789118155.740943:0:23413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789118155.740948:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1789118155.741267:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87d79450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+19:19093:x1876025572246016:12345-192.168.204.30@tcp:49:dd.0 Request processed in 449us (2765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.741275:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 10 00000100:00100000:1.0:1789118155.748629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.748788:0:23380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572246272 00000100:00100000:2.0:1789118155.748800:0:23380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572246272 00000100:00100000:2.0:1789118155.748890:0:23380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 11 00000100:00100000:2.0:1789118155.748901:0:23380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a85fc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+19:19095:x1876025572246272:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789118155.749303:0:23380:0:(mdd_object.c:4024:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789118155.749340:0:23380:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1789118155.749380:0:23380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b80031a00/0xaa253ed19be21c50 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.749399:0:23380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962b80031a00/0xaa253ed19be21c50 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.749431:0:23380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962b80031a00/0xaa253ed19be21c50 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.749439:0:23380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b80031a00/0xaa253ed19be21c50 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.749445:0:23380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff962b80031a00/0xaa253ed19be21c50 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.749450:0:23380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff962b80031a00/0xaa253ed19be21c50 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.749478:0:23380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789118155.749572:0:23380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a85fc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+21:19095:x1876025572246272:12345-192.168.204.30@tcp:35:lhsmtool_posix.0 Request processed in 671us (954us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1789118155.749580:0:23380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 11 00000020:00080000:2.0:1789118155.749586:0:23380:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789118155.749713:0:25929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789118155.749721:0:25929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff962b80031a00/0xaa253ed19be21c50 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118155.749729:0:25929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80031a00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:3.0:1789118155.749733:0:25929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b80031a00/0xaa253ed19be21c50 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118155.749741:0:25929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff962b80031a00/0xaa253ed19be21c50 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118155.749755:0:25929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff962b95eadc00) 00010000:00010000:3.0:1789118155.749757:0:25929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789118155.749762:0:25929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff962b80031a00/0xaa253ed19be21c50 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118155.749771:0:25929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962b80031a00/0xaa253ed19be21c50 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 23380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118155.749783:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118155.749784:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789118155.749786:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789118155.751924:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:1.0:1789118155.752399:0:23377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572246400 00000100:00100000:1.0:1789118155.752411:0:23377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572246400 00000100:00100000:1.0:1789118155.752489:0:23377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 64 00000100:00100000:1.0:1789118155.752501:0:23377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962bbfd17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+21:19093:x1876025572246400:12345-192.168.204.30@tcp:101:dd.0 00010000:00010000:1.0:1789118155.752527:0:23377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789118155.752553:0:23377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be21c57 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xddc6b953eac0f5a4 expref: -99 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.752624:0:23377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b600/0xaa253ed19be21c5e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.752646:0:23377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b600/0xaa253ed19be21c5e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.752661:0:23377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b600/0xaa253ed19be21c5e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.752824:0:23377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9bc00/0xaa253ed19be21c57 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f5a4 expref: 23 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.752845:0:23377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff962baea9b600/0xaa253ed19be21c5e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f5a4 expref: 22 pid: 23377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.752854:0:23377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff962b82d62100) 00010000:00010000:1.0:1789118155.752858:0:23377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789118155.752861:0:23377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff962baea9b600, rc 0) 00000100:00100000:1.0:1789118155.752953:0:23377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962bbfd17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+22:19093:x1876025572246400:12345-192.168.204.30@tcp:101:dd.0 Request processed in 455us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118155.752961:0:23377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 64 00010000:00010000:1.0:1789118155.813610:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789118155.928007:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.928149:0:24896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572246528 00000100:00100000:2.0:1789118155.928160:0:24896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572246528 00000100:00100000:2.0:1789118155.930049:0:24896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:2.0:1789118155.930095:0:24896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a85fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+8:2406:x1876025572246528:12345-192.168.204.30@tcp:4:dd.0 00010000:00010000:2.0:1789118155.930145:0:24896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a12eabc/0xaa253ed19be21c65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.930165:0:24896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000079d9f570/0xaa253ed19be21c26 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f59d expref: 8 pid: 24890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.930174:0:24896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789118155.930193:0:24896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118155.930198:0:24896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a12eabc/0xaa253ed19be21c65 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.930708:0:24896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000079d9f570/0xaa253ed19be21c26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f59d expref: 8 pid: 24890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.930731:0:24896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000079d9f570/0xaa253ed19be21c26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f59d expref: 8 pid: 24890 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118155.930750:0:24896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:24896:1876025593344128:192.168.204.30@tcp:104: 00000100:00100000:2.0:1789118155.931393:0:24896:0:(client.c:2715:ptlrpc_set_wait()) set ffff962bb5c64cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789118155.934977:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:0.0:1789118155.935145:0:24898:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789118155.935158:0:24898:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789118155.938687:0:24898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572246656 00000100:00100000:0.0:1789118155.938703:0:24898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572246656 00000100:00100000:1.0:1789118155.940156:0:24896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:24896:1876025593344128:192.168.204.30@tcp:104: 00010000:00010000:1.0:1789118155.940194:0:24896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a12eabc/0xaa253ed19be21c65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118155.940438:0:26436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 1 00000100:00100000:2.0:1789118155.940452:0:26436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a85fc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+9:2406:x1876025572246656:12345-192.168.204.30@tcp:4:dd.0 00010000:00010000:2.0:1789118155.940492:0:26436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8735a64/0xaa253ed19be21c6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.940508:0:26436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118155.940512:0:26436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118155.940517:0:26436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8735a64/0xaa253ed19be21c6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.940526:0:26436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8735a64/0xaa253ed19be21c6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789118155.941660:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.30@tcp (source: 12345-192.168.204.30@tcp) 00000100:00100000:2.0:1789118155.943402:0:23363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025572246784 00000100:00100000:2.0:1789118155.943432:0:23363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025572246784 00010000:00010000:2.0:1789118155.943481:0:23363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000079d9f570/0xaa253ed19be21c26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f59d expref: 10 pid: 24890 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118155.943529:0:23363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.30@tcp, seq: 21 00000100:00100000:2.0:1789118155.943540:0:23363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a85fc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+10:2405:x1876025572246784:12345-192.168.204.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789118155.943567:0:23363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789118155.943602:0:23363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000079d9f570/0xaa253ed19be21c26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f59d expref: 10 pid: 24890 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.943619:0:23363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000079d9f570/0xaa253ed19be21c26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f59d expref: 10 pid: 24890 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.944344:0:23363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079d9f570/0xaa253ed19be21c26 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.30@tcp remote: 0xddc6b953eac0f59d expref: 10 pid: 24890 timeout: 908 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.944365:0:23363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118155.944370:0:23363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118155.944376:0:23363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a12eabc/0xaa253ed19be21c65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.944396:0:23363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a12eabc/0xaa253ed19be21c65 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.944405:0:23363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118155.944407:0:23363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789118155.944411:0:23363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8735a64/0xaa253ed19be21c6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.944429:0:23363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8735a64/0xaa253ed19be21c6c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118155.944476:0:23363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789118155.944625:0:26436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8735a64/0xaa253ed19be21c6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789118155.944641:0:26436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8735a64/0xaa253ed19be21c6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118155.945780:0:23363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a85fc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d29d87d8-e620-4bf4-8433-b91e751a0764+9:2405:x1876025572246784:12345-192.168.204.30@tcp:103:ldlm_bl.0 Request processed in 2234us (4124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118155.945793:0:23363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 21 00010000:00010000:1.0:1789118155.948044:0:24896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a12eabc/0xaa253ed19be21c65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789118155.948094:0:24896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a12eabc/0xaa253ed19be21c65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789118156.095018:0:25706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:0.0:1789118156.095048:0:25706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1789118156.095550:0:24896:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1789118156.095557:0:24896:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1789118155 -> 1789118156 00002000:00010000:2.0:1789118156.095561:0:24896:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789118155 -> 1789118156 00002000:00010000:2.0:1789118156.095564:0:24896:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1789118156.095587:0:24896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a12eabc/0xaa253ed19be21c65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118156.095603:0:24896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a12eabc/0xaa253ed19be21c65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118156.095614:0:24896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a12eabc/0xaa253ed19be21c65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118156.095622:0:24896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80030a00 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118156.095629:0:24896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a12eabc/0xaa253ed19be21c65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118156.095640:0:24896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a12eabc/0xaa253ed19be21c65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118156.095684:0:24896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a12eabc/0xaa253ed19be21c65 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118156.095692:0:24896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a12eabc/0xaa253ed19be21c65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118156.095847:0:24896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a85fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d29d87d8-e620-4bf4-8433-b91e751a0764+7:2406:x1876025572246528:12345-192.168.204.30@tcp:4:dd.0 Request processed in 165760us (167845us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789118156.095872:0:24896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 0 00000100:00100000:1.0:1789118156.139993:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86a6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593344256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789118156.140108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118156.140223:0:24893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593344256 00000100:00100000:3.0:1789118156.140241:0:24893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593344256 00000100:00100000:3.0:1789118156.140331:0:24893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789118156.140344:0:24893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a85fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593344256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789118156.140393:0:24893:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789118156.140582:0:24893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a85fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593344256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 241us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789118156.140591:0:24893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789118156.140660:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86a6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593344256:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789118156.143395:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789118156.143832:0:25706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:2.0:1789118156.150255:0:26436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1789118156.150271:0:26436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1789118156.150308:0:26436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8735a64/0xaa253ed19be21c6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118156.150323:0:26436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8735a64/0xaa253ed19be21c6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118156.150333:0:26436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8735a64/0xaa253ed19be21c6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118156.150412:0:26436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff962b80030800 already unused, calling callback (ffffffffc0da7550) 00010000:00010000:2.0:1789118156.150418:0:26436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8735a64/0xaa253ed19be21c6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118156.150492:0:26436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8735a64/0xaa253ed19be21c6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118156.150563:0:26436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8735a64/0xaa253ed19be21c6c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789118156.150572:0:26436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8735a64/0xaa253ed19be21c6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789118156.150869:0:26436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a85fc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d29d87d8-e620-4bf4-8433-b91e751a0764+5:2406:x1876025572246656:12345-192.168.204.30@tcp:4:dd.0 Request processed in 210400us (215882us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1789118156.150885:0:26436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.30@tcp, seq: 1 00010000:00010000:3.0:1789118156.837840:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789118157.100245:0:24138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789118157.157377:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a85fcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593344384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789118157.158078:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789118157.158947:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789118157.158969:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962bbfd15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593344512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789118157.159034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789118157.159193:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593344384 00000100:00100000:1.0:1789118157.159218:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593344384 00000100:00100000:1.0:1789118157.159290:0:23382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593344512 00000100:00100000:1.0:1789118157.159294:0:23382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593344512 00000100:00100000:1.0:1789118157.159327:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789118157.159340:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a85fca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593344384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789118157.159416:0:23382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1789118157.159489:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a85fca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876025593344384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118157.159498:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789118157.159525:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789118157.159533:0:23382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593344512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789118157.159555:0:23382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789118157.159592:0:23382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593344512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789118157.159627:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789118157.159699:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a85fcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876025593344384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789118157.160643:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962bbfd15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593344512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789118157.672524:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593344640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789118157.672634:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118157.672719:0:24893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593344640 00000100:00100000:2.0:1789118157.672727:0:24893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593344640 00000100:00100000:2.0:1789118157.672811:0:24893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789118157.672825:0:24893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593344640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789118157.672867:0:24893:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923501056 avail 3684274176 00000100:00100000:2.0:1789118157.672924:0:24893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876025593344640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118157.672932:0:24893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789118157.672958:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789118157.672991:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:2.0:1789118157.672997:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff962a85fc9a40, transno 12884901892 00000004:00080000:2.0:1789118157.673008:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:2.0:1789118157.673074:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876025593344640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789118157.673940:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86a6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593344768:0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.674009:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118157.674074:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593345280:0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.674112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118157.674132:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86a6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593345792:0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.674163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118157.674186:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789118157.674191:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86a6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593344896:0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.674214:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118157.674233:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86a6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593345408:0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.674337:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118157.674378:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86a6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593345920:0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.674407:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118157.674453:0:23370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593344768 00000100:00100000:0.0:1789118157.674463:0:23370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593344768 00000100:00100000:0.0:1789118157.674518:0:23370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789118157.674529:0:23370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a87c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:3646:x1876025593344768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.674583:0:23370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a87c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b+24:3646:x1876025593344768:12345-0@lo:400:kworker.0 Request processed in 56us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118157.674590:0:23370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789118157.674630:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593345280 00000100:00100000:0.0:1789118157.674634:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593345280 00000100:00100000:0.0:1789118157.674669:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593344896 00000100:00100000:0.0:1789118157.674673:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593344896 00000100:00100000:0.0:1789118157.674702:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789118157.674709:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86a6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593345280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.674744:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86a6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876025593345280:12345-0@lo:400:kworker.0 Request processed in 37us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118157.674752:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789118157.674764:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789118157.674770:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86a6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593344896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.674800:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86a6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876025593344896:12345-0@lo:400:kworker.0 Request processed in 30us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118157.674806:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789118157.674824:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593345792 00000100:00100000:0.0:1789118157.674828:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593345792 00000100:00100000:0.0:1789118157.674871:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593345408 00000100:00100000:0.0:1789118157.674874:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593345408 00000100:00100000:0.0:1789118157.674886:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593345920 00000100:00100000:0.0:1789118157.674896:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593345920 00000100:00100000:0.0:1789118157.674916:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789118157.674922:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86a6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593345792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.674954:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86a6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876025593345792:12345-0@lo:400:kworker.0 Request processed in 33us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118157.674961:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789118157.674974:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789118157.674980:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86a6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593345408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.675008:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86a6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876025593345408:12345-0@lo:400:kworker.0 Request processed in 28us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118157.675013:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789118157.675024:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789118157.675029:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a86a6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593345920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.675085:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a86a6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876025593345920:12345-0@lo:400:kworker.0 Request processed in 55us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118157.675091:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789118157.675148:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86a6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876025593344896:0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.675162:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86a6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876025593345408:0@lo:400:kworker.0 00010000:00080000:0.0:1789118157.675177:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a86a6e580 x1876025593345920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789118157.675189:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86a6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876025593345920:0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.675198:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86a6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bd02e7cb-2aaa-4c88-8dd4-a19e9d88ad3b:3646:1876025593344768:0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.675208:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876025593345280:0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.675232:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86a6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876025593345792:0@lo:400:kworker.0 00000100:00100000:2.0:1789118157.677550:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86a6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593345024:0@lo:400:kworker.0 00000100:00100000:2.0:1789118157.677709:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118157.677766:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86a6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593345536:0@lo:400:kworker.0 00000100:00100000:2.0:1789118157.677799:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118157.677850:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789118157.677860:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86a6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593345152:0@lo:400:kworker.0 00000100:00100000:2.0:1789118157.677896:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118157.677930:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593345664:0@lo:400:kworker.0 00000100:00100000:2.0:1789118157.677964:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118157.678012:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593345024 00000100:00100000:2.0:1789118157.678022:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593345024 00000100:00100000:2.0:1789118157.678115:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593345536 00000100:00100000:2.0:1789118157.678119:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593345536 00000100:00100000:2.0:1789118157.678139:0:23379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593345664 00000100:00100000:2.0:1789118157.678141:0:23379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593345664 00000100:00100000:2.0:1789118157.678159:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789118157.678169:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593345024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118157.678241:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876025593345024:12345-0@lo:400:kworker.0 Request processed in 73us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118157.678432:0:25927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593345152 00000100:00100000:0.0:1789118157.678438:0:25927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593345152 00000100:00100000:0.0:1789118157.678473:0:25927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789118157.678481:0:25927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0718b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593345152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789118157.678525:0:25927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0718b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593345152:12345-0@lo:400:kworker.0 Request processed in 46us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118157.678532:0:25927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789118157.678894:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789118157.678916:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789118157.678925:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962ba0719680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593345536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118157.678963:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962ba0719680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876025593345536:12345-0@lo:400:kworker.0 Request processed in 41us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118157.678969:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789118157.678982:0:23379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789118157.678988:0:23379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962a88564b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593345664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789118157.679031:0:23379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962a88564b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876025593345664:12345-0@lo:400:kworker.0 Request processed in 43us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118157.679037:0:23379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1789118157.679102:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789118157.679108:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789118157.679113:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789118157.679117:0:23373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789118157.679162:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86a6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593345152:0@lo:400:kworker.0 00010000:00080000:2.0:1789118157.679178:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff962a86a6c000 x1876025593345664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789118173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789118157.679190:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876025593345664:0@lo:400:kworker.0 00000100:00100000:2.0:1789118157.679201:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86a6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876025593345024:0@lo:400:kworker.0 00000100:00100000:2.0:1789118157.679210:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86a6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876025593345536:0@lo:400:kworker.0 00000100:00100000:3.0:1789118157.679859:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962b98a303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593346048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789118157.679919:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789118157.680462:0:24893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593346048 00000100:00100000:2.0:1789118157.680472:0:24893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593346048 00000100:00100000:2.0:1789118157.680527:0:24893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789118157.680537:0:24893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593346048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789118157.680566:0:24893:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923501056 avail 3684274176 00000100:00100000:2.0:1789118157.680632:0:24893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876025593346048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789118157.680640:0:24893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789118157.680705:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962b98a303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876025593346048:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789118157.863092:0:25929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789118158.193306:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789118158.199144:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff962a86a6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593346176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789118158.199258:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789118158.199386:0:24893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876025593346176 00000100:00100000:0.0:1789118158.199396:0:24893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876025593346176 00000100:00100000:0.0:1789118158.199472:0:24893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789118158.199485:0:24893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff962b98a32d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593346176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789118158.199544:0:24893:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789118158.199617:0:24893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff962b98a32d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876025593346176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789118158.199627:0:24893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789118158.200367:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff962a86a6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876025593346176:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789118158.202565:0:26473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1789118158.885286:0:23366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789118159.864764:0:23413:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789118159.864775:0:23413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789118159.864813:0:23413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789118159.864821:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1789118159.909632:0:23365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14514 lines, 14514 kept, 0 dropped, 0 bad.