00010000:00010000:3.0F:1788791961.814492:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791962.646275:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785795456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788791962.646351:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1788791962.646748:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785795456 00000100:00100000:0.0:1788791962.646777:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785795456 00000100:00100000:0.0:1788791962.646865:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788791962.646895:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6175d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785795456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791962.646929:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788791962.646986:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6175d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785795456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791962.646994:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788791962.647014:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788791962.647051:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785795456:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0F:1788791962.844660:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788791963.163335:0:17076:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1788791963.163356:0:17076:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c60435d2d80 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1788791963.163362:0:17076:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c60433bdb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c60435d2a80 00000020:00080000:0.0:1788791963.163366:0:17076:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c60433bdf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c618130e600 00000020:00080000:1.0F:1788791963.163430:0:17136:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00010000:00010000:3.0:1788791963.163433:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c618217ea00/0x4d37c11031f36132 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791963.163457:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c618217ea00/0x4d37c11031f36132 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791963.163466:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c618217ea00/0x4d37c11031f36132 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791963.163473:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c618217ea00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:3.0:1788791963.163479:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c618217ea00/0x4d37c11031f36132 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791963.163488:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c618217ea00/0x4d37c11031f36132 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791963.163510:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c6042485c00) 00010000:00010000:3.0:1788791963.163513:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1788791963.163519:0:17136:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788791963.163520:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c618217ea00/0x4d37c11031f36132 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791963.163529:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c618217ea00/0x4d37c11031f36132 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788791963.289568:0:17132:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788791963.289577:0:17132:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788791963.289599:0:17132:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788791963.289605:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788791963.421368:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788791963.421427:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788791963.421462:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788791963.421495:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760550528 00000100:00100000:1.0:1788791963.421507:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760550528 00000100:00100000:1.0:1788791963.421582:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760550400 00000100:00100000:1.0:1788791963.421586:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760550400 00000100:00100000:2.0:1788791963.421599:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760550272 00000100:00100000:2.0:1788791963.421604:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760550272 00000100:00100000:1.0:1788791963.421613:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:1.0:1788791963.421624:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:803e9a46-551b-4171-b661-e561c059a809+5:2422:x1875683760550528:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788791963.421631:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 169 00000100:00100000:2.0:1788791963.421636:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45e61654-910c-4348-9ed1-eb146143af9d+13:2422:x1875683760550272:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788791963.421726:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:3.0:1788791963.421736:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:803e9a46-551b-4171-b661-e561c059a809+13:2422:x1875683760550400:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788791963.421794:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:803e9a46-551b-4171-b661-e561c059a809+5:2422:x1875683760550528:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 171us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791963.421802:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00080000:1.0:1788791963.421822:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788791963.421826:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788791963.430949:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:803e9a46-551b-4171-b661-e561c059a809+13:2422:x1875683760550400:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 9204us (9474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791963.430949:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45e61654-910c-4348-9ed1-eb146143af9d+13:2422:x1875683760550272:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 9296us (9578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791963.430969:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 169 00000100:00100000:3.0:1788791963.430984:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:3.0:1788791963.435852:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788791963.436141:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788791963.436180:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788791963.436202:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788791963.436224:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788791963.436480:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788791963.436514:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760550656 00000100:00100000:3.0:1788791963.436528:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760550656 00000100:00100000:3.0:1788791963.436855:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760550784 00000100:00100000:3.0:1788791963.436859:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760550784 00000100:00100000:3.0:1788791963.436991:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760551168 00000100:00100000:3.0:1788791963.436995:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760551168 00000100:00100000:3.0:1788791963.437010:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760551296 00000100:00100000:3.0:1788791963.437013:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760551296 00000100:00100000:3.0:1788791963.437031:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:3.0:1788791963.437044:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60431a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:803e9a46-551b-4171-b661-e561c059a809+5:2421:x1875683760550784:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788791963.437115:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60431a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:803e9a46-551b-4171-b661-e561c059a809+5:2421:x1875683760550784:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 75us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791963.437123:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:3.0:1788791963.438534:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:3.0:1788791963.438566:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6175d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:803e9a46-551b-4171-b661-e561c059a809+5:2418:x1875683760550656:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:3.0:1788791963.438597:0:18605:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35e61 00000100:00080000:3.0:1788791963.438614:0:18605:0:(import.c:65:import_set_state_nolock()) ffff8c6181229000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788791963.438670:0:18605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788791963.438926:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6175d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:803e9a46-551b-4171-b661-e561c059a809+2:2418:x1875683760550656:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 379us (3085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791963.438944:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:3.0:1788791963.438968:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:3.0:1788791963.438976:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60437cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f326547c-6736-444b-8513-e15cf2948667+5:2418:x1875683760551168:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:3.0:1788791963.438991:0:18605:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35ea0 00000100:00080000:3.0:1788791963.438997:0:18605:0:(import.c:65:import_set_state_nolock()) ffff8c604353e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788791963.439035:0:18605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788791963.439086:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60437cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f326547c-6736-444b-8513-e15cf2948667+2:2418:x1875683760551168:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 111us (2861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791963.439086:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:3.0:1788791963.439093:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:2.0:1788791963.439097:0:19084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60437cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f326547c-6736-444b-8513-e15cf2948667+5:2418:x1875683760551296:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:2.0:1788791963.439111:0:19084:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35ea7 00000100:00080000:2.0:1788791963.439122:0:19084:0:(import.c:65:import_set_state_nolock()) ffff8c6174fa6800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788791963.439146:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788791963.439151:0:19084:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00010000:00010000:3.0:1788791963.439152:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788791963.439159:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788791963.439163:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788791963.439200:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760551040 00000100:00100000:3.0:1788791963.439207:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760551040 00000100:00100000:3.0:1788791963.439266:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760550912 00000100:00100000:3.0:1788791963.439270:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760550912 00000100:00100000:3.0:1788791963.439293:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:3.0:1788791963.439299:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60437cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f326547c-6736-444b-8513-e15cf2948667+5:2421:x1875683760551040:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788791963.439332:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60437cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f326547c-6736-444b-8513-e15cf2948667+5:2421:x1875683760551040:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (3152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791963.439338:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:3.0:1788791963.439351:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:3.0:1788791963.439356:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60437ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f326547c-6736-444b-8513-e15cf2948667+6:2421:x1875683760550912:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788791963.439376:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60437ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f326547c-6736-444b-8513-e15cf2948667+6:2421:x1875683760550912:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20us (3173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791963.439388:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00080000:3.0:1788791963.439412:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788791963.439414:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788791963.439432:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791963.445823:0:19084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60437cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f326547c-6736-444b-8513-e15cf2948667+2:2418:x1875683760551296:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 6714us (9329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791963.445852:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:1.0:1788791963.677063:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785795584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788791963.677145:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791963.677213:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791963.677220:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785795712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788791963.677259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791963.677295:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785795712 00000100:00100000:1.0:1788791963.677303:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785795712 00000100:00100000:1.0:1788791963.677359:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788791963.677369:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785795712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788791963.677414:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788791963.677459:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785795712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791963.677467:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788791963.677520:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785795712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788791963.679055:0:17811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785795584 00000100:00100000:3.0:1788791963.679070:0:17811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785795584 00000100:00100000:3.0:1788791963.679130:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788791963.679139:0:17811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785795584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788791963.679172:0:17811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788791963.679257:0:17811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785795584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (2111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791963.679265:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788791963.679291:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788791963.679334:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785795584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788791963.863768:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791964.183722:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785795840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788791964.183801:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791964.184050:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785795840 00000100:00100000:3.0:1788791964.184058:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785795840 00000100:00100000:3.0:1788791964.184249:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788791964.184260:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785795840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788791964.184295:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788791964.184383:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785795840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791964.184391:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788791964.184589:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785795840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788791964.518110:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788791964.518236:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760551424 00000100:00100000:3.0:1788791964.518248:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760551424 00000100:00100000:3.0:1788791964.518313:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:3.0:1788791964.518325:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:803e9a46-551b-4171-b661-e561c059a809+13:15602:x1875683760551424:12345-192.168.201.20@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788791964.518453:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:803e9a46-551b-4171-b661-e561c059a809+13:15602:x1875683760551424:12345-192.168.201.20@tcp:60:lhsmtool_posix.0 Request processed in 129us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791964.518461:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:1.0:1788791964.539734:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788791964.539829:0:19939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760551552 00000100:00100000:3.0:1788791964.539839:0:19939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760551552 00000100:00100000:3.0:1788791964.539951:0:19939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:3.0:1788791964.539963:0:19939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:803e9a46-551b-4171-b661-e561c059a809+5:15602:x1875683760551552:12345-192.168.201.20@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788791964.540087:0:19939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:803e9a46-551b-4171-b661-e561c059a809+5:15602:x1875683760551552:12345-192.168.201.20@tcp:60:lhsmtool_posix.0 Request processed in 126us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791964.540094:0:19939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:1.0:1788791964.564759:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788791964.564916:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760551808 00000100:00100000:0.0:1788791964.564927:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760551808 00000100:00100000:0.0:1788791964.564991:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:0.0:1788791964.565002:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:803e9a46-551b-4171-b661-e561c059a809+13:15602:x1875683760551808:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788791964.565548:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:803e9a46-551b-4171-b661-e561c059a809+14:15602:x1875683760551808:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 545us (800us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788791964.565556:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00010000:00010000:3.0:1788791964.889535:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791965.718180:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785795968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791965.718283:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791965.719174:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788791965.719187:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785796096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788791965.719239:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791965.719497:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785795968 00000100:00100000:2.0:1788791965.719506:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785795968 00000100:00100000:2.0:1788791965.719560:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785796096 00000100:00100000:2.0:1788791965.719563:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785796096 00000100:00100000:2.0:1788791965.719581:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788791965.719589:0:18607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785795968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788791965.719617:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788791965.719665:0:18607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785795968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791965.719672:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788791965.719688:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788791965.719695:0:18607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785796096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788791965.719716:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788791965.719744:0:18607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785796096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791965.719751:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788791965.720487:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788791965.720517:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3642:1875683785796224:0@lo:400:kworker.0 00000100:00100000:1.0:1788791965.720565:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791965.720610:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785796736:0@lo:400:kworker.0 00000100:00100000:1.0:1788791965.720634:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791965.720651:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875683785797248:0@lo:400:kworker.0 00000100:00100000:1.0:1788791965.720676:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791965.720694:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785796480:0@lo:400:kworker.0 00000100:00100000:1.0:1788791965.720713:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785796096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788791965.720743:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788791965.720749:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875683785796608:0@lo:400:kworker.0 00000100:00100000:1.0:1788791965.720772:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791965.720787:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875683785797120:0@lo:400:kworker.0 00000100:00100000:1.0:1788791965.720806:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791965.720831:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791965.720833:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785797248 00000100:00100000:1.0:1788791965.720838:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785797248 00000100:00100000:2.0:1788791965.720847:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875683785796992:0@lo:400:kworker.0 00000100:00100000:2.0:1788791965.720867:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791965.720895:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785796608 00000100:00100000:2.0:1788791965.720897:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875683785797504:0@lo:400:kworker.0 00000100:00100000:1.0:1788791965.720898:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785796608 00000100:00100000:1.0:1788791965.720911:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785797120 00000100:00100000:1.0:1788791965.720914:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785797120 00000100:00100000:2.0:1788791965.720918:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791965.720925:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785796992 00000100:00100000:1.0:1788791965.720927:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785796992 00000100:00100000:2.0:1788791965.720940:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785795968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791965.720952:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788791965.720955:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785797504 00000100:00100000:2.0:1788791965.720958:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785796352:0@lo:400:kworker.0 00000100:00100000:1.0:1788791965.720958:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785797504 00000100:00100000:1.0:1788791965.720971:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788791965.720977:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875683785797248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791965.720978:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791965.720993:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785796864:0@lo:400:kworker.0 00000100:00100000:2.0:1788791965.721009:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791965.721016:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875683785797248:12345-0@lo:400:kworker.0 Request processed in 39us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791965.721022:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875683785797376:0@lo:400:kworker.0 00000100:00100000:1.0:1788791965.721022:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788791965.721037:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788791965.721039:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791965.721042:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875683785796608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791965.721065:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785797376 00000100:00100000:1.0:1788791965.721066:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875683785796608:12345-0@lo:400:kworker.0 Request processed in 24us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791965.721068:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785797376 00000100:00100000:1.0:1788791965.721072:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788791965.721082:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788791965.721086:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788791965.721087:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875683785797120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791965.721091:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875683785796992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791965.721116:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875683785797120:12345-0@lo:400:kworker.0 Request processed in 28us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791965.721118:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875683785796992:12345-0@lo:400:kworker.0 Request processed in 28us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791965.721122:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788791965.721131:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788791965.721134:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788791965.721139:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875683785797504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791965.721141:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788791965.721145:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875683785797376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791965.721184:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875683785797376:12345-0@lo:400:kworker.0 Request processed in 37us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791965.721189:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788791965.721214:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788791965.721217:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788791965.721233:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875683785797376:0@lo:400:kworker.0 00000100:00100000:2.0:1788791965.721243:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875683785796992:0@lo:400:kworker.0 00000100:00100000:0.0:1788791965.721516:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785796224 00000100:00100000:0.0:1788791965.721522:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785796224 00000100:00100000:0.0:1788791965.721560:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788791965.721567:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b5ad001-761f-497e-bfbf-b3c6140a93fd+24:3642:x1875683785796224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791965.721602:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b5ad001-761f-497e-bfbf-b3c6140a93fd+24:3642:x1875683785796224:12345-0@lo:400:kworker.0 Request processed in 36us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791965.721615:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788791965.721661:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875683785796608:0@lo:400:kworker.0 00000100:00100000:0.0:1788791965.721670:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875683785797120:0@lo:400:kworker.0 00000100:00100000:0.0:1788791965.721677:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3642:1875683785796224:0@lo:400:kworker.0 00010000:00080000:0.0:1788791965.721688:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6043d9df80 x1875683785797248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791965.721697:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875683785797248:0@lo:400:kworker.0 00000100:00100000:1.0:1788791965.724360:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875683785797504:12345-0@lo:400:kworker.0 Request processed in 3211us (3431us total) trans 0 rc 0/0 00010000:00080000:2.0:1788791965.724420:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6043d9c000 x1875683785797504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791965.724437:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875683785797504:0@lo:400:kworker.0 00000100:00100000:1.0:1788791965.724494:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788791965.724511:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785796736 00000100:00100000:2.0:1788791965.724519:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785796736 00000100:00100000:2.0:1788791965.724571:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785796352 00000100:00100000:2.0:1788791965.724574:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785796352 00000100:00100000:2.0:1788791965.724588:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788791965.724596:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60420c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785796736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791965.724672:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60420c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785796736:12345-0@lo:400:kworker.0 Request processed in 77us (4036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791965.724678:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788791965.724688:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788791965.724694:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785796352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791965.724822:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785796736:0@lo:400:kworker.0 00000100:00100000:2.0:1788791965.724913:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785796352:12345-0@lo:400:kworker.0 Request processed in 219us (3933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791965.724920:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788791965.724947:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785796352:0@lo:400:kworker.0 00000100:00100000:3.0:1788791965.729864:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785796480 00000100:00100000:3.0:1788791965.729889:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785796480 00000100:00100000:3.0:1788791965.729965:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785796864 00000100:00100000:3.0:1788791965.729968:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785796864 00000100:00100000:3.0:1788791965.729995:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788791965.730004:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785796480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791965.730091:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785796480:12345-0@lo:400:kworker.0 Request processed in 88us (9260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791965.730097:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788791965.730111:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788791965.730117:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785796864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791965.730137:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785796864:12345-0@lo:400:kworker.0 Request processed in 21us (9127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791965.730143:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788791965.730189:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791965.746447:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785796864:0@lo:400:kworker.0 00000100:00100000:2.0:1788791965.746471:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785796480:0@lo:400:kworker.0 00010000:00010000:3.0:1788791965.912033:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791966.934233:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791967.768483:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788791967.768512:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c614f4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785797632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791967.768592:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791967.768717:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785797632 00000100:00100000:2.0:1788791967.768727:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785797632 00000100:00100000:2.0:1788791967.768823:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788791967.768834:0:18607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604370bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785797632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788791967.768928:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788791967.768981:0:18607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604370bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785797632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791967.768988:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788791967.769149:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788791967.769195:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c614f4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785797632:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788791967.958280:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791968.558953:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788791968.559005:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788791968.559101:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760552064 00000100:00100000:1.0:1788791968.559110:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760552064 00000100:00100000:1.0:1788791968.559198:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:1.0:1788791968.559208:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:803e9a46-551b-4171-b661-e561c059a809+14:2422:x1875683760552064:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788791968.559288:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:803e9a46-551b-4171-b661-e561c059a809+14:2422:x1875683760552064:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 81us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791968.559295:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00080000:0.0:1788791968.559898:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791968.560926:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760551936 00000100:00100000:2.0:1788791968.560939:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760551936 00000100:00100000:2.0:1788791968.561001:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 171 00000100:00100000:2.0:1788791968.561010:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45e61654-910c-4348-9ed1-eb146143af9d+13:2422:x1875683760551936:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788791968.561084:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45e61654-910c-4348-9ed1-eb146143af9d+13:2422:x1875683760551936:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 75us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791968.561092:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 171 00000100:00100000:0.0:1788791968.570238:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788791968.570333:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788791968.570366:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788791968.570402:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788791968.571921:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760552576 00000100:00100000:2.0:1788791968.571935:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760552576 00000100:00100000:2.0:1788791968.572014:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760552192 00000100:00100000:2.0:1788791968.572017:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760552192 00000100:00100000:2.0:1788791968.572061:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760552448 00000100:00100000:2.0:1788791968.572065:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760552448 00000100:00100000:2.0:1788791968.572088:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:2.0:1788791968.572098:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f326547c-6736-444b-8513-e15cf2948667+5:2421:x1875683760552576:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788791968.572199:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f326547c-6736-444b-8513-e15cf2948667+5:2421:x1875683760552576:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 102us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791968.572206:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:2.0:1788791968.572225:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:2.0:1788791968.572232:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:803e9a46-551b-4171-b661-e561c059a809+5:2421:x1875683760552192:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788791968.572258:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:803e9a46-551b-4171-b661-e561c059a809+5:2421:x1875683760552192:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791968.572265:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:2.0:1788791968.572277:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:2.0:1788791968.572283:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f326547c-6736-444b-8513-e15cf2948667+6:2421:x1875683760552448:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788791968.572307:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f326547c-6736-444b-8513-e15cf2948667+6:2421:x1875683760552448:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791968.572313:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00080000:0.0:1788791968.572444:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788791968.572450:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788791968.576965:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760552320 00000100:00100000:3.0:1788791968.576980:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760552320 00000100:00100000:3.0:1788791968.577058:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:3.0:1788791968.577069:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:803e9a46-551b-4171-b661-e561c059a809+5:2421:x1875683760552320:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788791968.577179:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:803e9a46-551b-4171-b661-e561c059a809+5:2421:x1875683760552320:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 110us (6952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791968.577186:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00080000:0.0:1788791968.577476:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788791968.790857:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788791968.791024:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785797760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788791968.791092:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791968.792248:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785797760 00000100:00100000:2.0:1788791968.792263:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785797760 00000100:00100000:2.0:1788791968.792612:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788791968.792624:0:18607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785797760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788791968.792648:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788791968.792772:0:18607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785797760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791968.792779:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788791968.792934:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c614f4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785797888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788791968.792964:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791968.793025:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785797760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788791968.793265:0:17811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785797888 00000100:00100000:0.0:1788791968.793276:0:17811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785797888 00000100:00100000:0.0:1788791968.793307:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788791968.793314:0:17811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614f4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785797888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788791968.793341:0:17811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788791968.793380:0:17811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614f4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785797888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791968.793387:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788791968.793410:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c614f4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785797888:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788791968.793412:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788791968.795245:0:17076:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1788791968.795259:0:17076:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1788791968.795277:0:17136:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1788791968.795286:0:17136:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000001:00100000:2.0:1788791968.800075:0:18600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f326547c-6736-444b-8513-e15cf2948667 00000020:00000080:2.0:1788791968.800087:0:18600:0:(genops.c:885:class_export_put()) final put ffff8c604353b000/f326547c-6736-444b-8513-e15cf2948667 00000001:00100000:2.0:1788791968.800118:0:18600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 803e9a46-551b-4171-b661-e561c059a809 00000020:00000080:2.0:1788791968.800121:0:18600:0:(genops.c:885:class_export_put()) final put ffff8c618122d800/803e9a46-551b-4171-b661-e561c059a809 00000001:00100000:3.0:1788791968.801331:0:19419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f326547c-6736-444b-8513-e15cf2948667 00000020:00000080:3.0:1788791968.801338:0:19419:0:(genops.c:885:class_export_put()) final put ffff8c6174fa7800/f326547c-6736-444b-8513-e15cf2948667 00000020:00000080:1.0:1788791968.801822:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c604353b000/f326547c-6736-444b-8513-e15cf2948667 for lustre-OST0000 00000020:00000080:1.0:1788791968.801915:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c618122d800/803e9a46-551b-4171-b661-e561c059a809 for lustre-OST0000 00000020:00000080:1.0:1788791968.801935:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6174fa7800/f326547c-6736-444b-8513-e15cf2948667 for lustre-OST0001 00000020:00000080:1.0:1788791968.801949:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c604353e000 for lustre-OST0000 00000020:00000080:1.0:1788791968.801953:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6181229000 for lustre-OST0000 00000020:00000080:1.0:1788791968.801956:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6174fa6800 for lustre-OST0001 00010000:00010000:2.0:1788791968.983497:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791969.302105:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788791969.302142:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c614f4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785798016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788791969.302216:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791969.302392:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785798016 00000100:00100000:1.0:1788791969.302401:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785798016 00000100:00100000:1.0:1788791969.302456:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788791969.302467:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785798016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788791969.302503:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788791969.302557:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785798016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791969.302578:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788791969.302795:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c614f4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785798016:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788791969.678335:0:20475:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 10:39:27 (1788791967) 00010000:00010000:3.0:1788791970.007080:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788791970.008530:0:17851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788791970.855347:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c614f4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785798144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788791970.855421:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791970.855508:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785798144 00000100:00100000:1.0:1788791970.855517:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785798144 00000100:00100000:1.0:1788791970.855569:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788791970.855580:0:18607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614f4a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785798144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788791970.855627:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788791970.855683:0:18607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614f4a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785798144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791970.855690:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788791970.855727:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788791970.855774:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c614f4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785798144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788791970.856032:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785798272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791970.856065:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791970.860657:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785798528:0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.860740:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791970.861001:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785799040:0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.861033:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791970.861055:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60425d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875683785799552:0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.861080:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791970.861119:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788791970.861126:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3644:1875683785798400:0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.861161:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791970.861184:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785798912:0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.861209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791970.861225:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875683785799424:0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.861245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791970.861273:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785798656:0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.861322:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791970.861342:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875683785799168:0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.861362:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791970.861379:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60425daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875683785799680:0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.861398:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791970.861427:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788791970.861433:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785798784:0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.861456:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791970.861477:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875683785799296:0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.861502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791970.861540:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785798528 00000100:00100000:0.0:1788791970.861551:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785798528 00000100:00100000:0.0:1788791970.863168:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785798912 00000100:00100000:0.0:1788791970.863184:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785798912 00000100:00100000:3.0:1788791970.863580:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785798272 00000100:00100000:3.0:1788791970.863585:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785798272 00000100:00100000:3.0:1788791970.863733:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788791970.863749:0:18607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614f4a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785798272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788791970.863776:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788791970.863891:0:18607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614f4a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785798272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (7798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791970.863902:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788791970.864653:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788791970.864670:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785798528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791970.864759:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785798528:12345-0@lo:400:kworker.0 Request processed in 96us (4018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791970.864767:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788791970.864789:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788791970.864799:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785798912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791970.864831:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785798912:12345-0@lo:400:kworker.0 Request processed in 35us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791970.864837:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788791970.865202:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788791970.865606:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785798912:0@lo:400:kworker.0 00000100:00100000:2.0:1788791970.865627:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785798528:0@lo:400:kworker.0 00000100:00100000:1.0:1788791970.866018:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785799040 00000100:00100000:1.0:1788791970.866028:0:19084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785799040 00000100:00100000:1.0:1788791970.866086:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785798656 00000100:00100000:1.0:1788791970.866090:0:19084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785798656 00000100:00100000:1.0:1788791970.866126:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788791970.866136:0:19084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785799040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791970.866208:0:19084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785799040:12345-0@lo:400:kworker.0 Request processed in 73us (5173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791970.866215:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788791970.866230:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788791970.866236:0:19084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785798656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791970.866290:0:19084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785798656:12345-0@lo:400:kworker.0 Request processed in 54us (4967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791970.866297:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788791970.866316:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785799552 00000100:00100000:1.0:1788791970.866320:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785799552 00000100:00100000:1.0:1788791970.866342:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785799424 00000100:00100000:1.0:1788791970.866345:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785799424 00000100:00100000:1.0:1788791970.866358:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785799168 00000100:00100000:1.0:1788791970.866360:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785799168 00000100:00100000:1.0:1788791970.866373:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785799680 00000100:00100000:1.0:1788791970.866376:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785799680 00000100:00100000:1.0:1788791970.866398:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785798784 00000100:00100000:1.0:1788791970.866403:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785798784 00000100:00100000:1.0:1788791970.866416:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785799296 00000100:00100000:1.0:1788791970.866420:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785799296 00000100:00080000:2.0:1788791970.866552:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788791970.866557:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791970.866617:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788791970.866721:0:19939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788791970.866735:0:19939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875683785799424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.866796:0:19939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875683785799424:12345-0@lo:400:kworker.0 Request processed in 66us (5549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791970.866803:0:19939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788791970.866821:0:19939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1788791970.867172:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788791970.867217:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875683785799552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791970.867277:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875683785799552:12345-0@lo:400:kworker.0 Request processed in 650us (6195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791970.867285:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788791970.867300:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788791970.867308:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875683785799680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791970.867340:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875683785799680:12345-0@lo:400:kworker.0 Request processed in 34us (5940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791970.867346:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788791970.867357:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788791970.867363:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785798784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791970.867389:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785798784:12345-0@lo:400:kworker.0 Request processed in 26us (5932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791970.867401:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788791970.867414:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788791970.867420:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875683785799296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791970.867522:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875683785799296:12345-0@lo:400:kworker.0 Request processed in 101us (6018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791970.867529:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788791970.867560:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785798400 00000100:00100000:1.0:1788791970.867735:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785798400 00000100:00100000:1.0:1788791970.868185:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788791970.868195:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b5ad001-761f-497e-bfbf-b3c6140a93fd+24:3644:x1875683785798400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791970.868247:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b5ad001-761f-497e-bfbf-b3c6140a93fd+24:3644:x1875683785798400:12345-0@lo:400:kworker.0 Request processed in 54us (7085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791970.868254:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788791970.868405:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3644:1875683785798400:0@lo:400:kworker.0 00010000:00080000:1.0:1788791970.868492:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6043708e00 x1875683785799424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791970.868506:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875683785799424:0@lo:400:kworker.0 00000100:00100000:1.0:1788791970.868526:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785799040:0@lo:400:kworker.0 00000100:00100000:1.0:1788791970.868540:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60425d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875683785799552:0@lo:400:kworker.0 00000100:00100000:1.0:1788791970.868958:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785798272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791970.868981:0:19939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875683785799168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.869038:0:19939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875683785799168:12345-0@lo:400:kworker.0 Request processed in 2209us (7673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791970.869047:0:19939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788791970.869090:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785798784:0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.869133:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875683785799296:0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.869147:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785798656:0@lo:400:kworker.0 00000100:00100000:0.0:1788791970.869236:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875683785799168:0@lo:400:kworker.0 00010000:00080000:0.0:1788791970.869333:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c60425daa00 x1875683785799680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791970.869346:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60425daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875683785799680:0@lo:400:kworker.0 00010000:00010000:0.0:1788791971.033065:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791972.065347:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791972.886562:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c614f4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785799808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791972.886632:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791972.886736:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785799808 00000100:00100000:1.0:1788791972.886744:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785799808 00000100:00100000:1.0:1788791972.886809:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788791972.886835:0:18607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785799808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791972.886865:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788791972.886927:0:18607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785799808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791972.886934:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788791972.887000:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788791972.887033:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c614f4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785799808:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788791973.081234:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788791973.526305:0:17132:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788791973.526315:0:17132:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788791973.526355:0:17132:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788791973.526366:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788791973.659162:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788791973.659261:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788791973.659290:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788791973.659396:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760552960 00000100:00100000:1.0:1788791973.659406:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760552960 00000100:00100000:1.0:1788791973.659482:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:1.0:1788791973.659493:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:803e9a46-551b-4171-b661-e561c059a809+5:2422:x1875683760552960:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788791973.659568:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:803e9a46-551b-4171-b661-e561c059a809+5:2422:x1875683760552960:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 77us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791973.659575:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:0.0:1788791973.659758:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788791973.659783:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788791973.659806:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788791973.659824:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760553216 00000100:00100000:0.0:1788791973.659828:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760553216 00000100:00100000:0.0:1788791973.659853:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760552832 00000100:00100000:0.0:1788791973.659857:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760552832 00000100:00100000:0.0:1788791973.659905:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760553344 00000100:00100000:0.0:1788791973.659908:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760553344 00000100:00100000:0.0:1788791973.659928:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00100000:0.0:1788791973.659936:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f326547c-6736-444b-8513-e15cf2948667+6:2422:x1875683760553216:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788791973.660065:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f326547c-6736-444b-8513-e15cf2948667+6:2422:x1875683760553216:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 51us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791973.660074:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00100000:0.0:1788791973.660088:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:0.0:1788791973.660095:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:803e9a46-551b-4171-b661-e561c059a809+13:2422:x1875683760552832:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788791973.660120:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:803e9a46-551b-4171-b661-e561c059a809+13:2422:x1875683760552832:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791973.660127:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:0.0:1788791973.660138:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 102 00000100:00100000:0.0:1788791973.660145:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f326547c-6736-444b-8513-e15cf2948667+5:2422:x1875683760553344:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788791973.660167:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f326547c-6736-444b-8513-e15cf2948667+5:2422:x1875683760553344:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791973.660173:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 102 00000100:00100000:0.0:1788791973.660192:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760553088 00000100:00100000:0.0:1788791973.660195:0:19084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760553088 00000100:00100000:0.0:1788791973.660225:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:0.0:1788791973.660231:0:19084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:803e9a46-551b-4171-b661-e561c059a809+5:2422:x1875683760553088:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788791973.660254:0:19084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:803e9a46-551b-4171-b661-e561c059a809+5:2422:x1875683760553088:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791973.660260:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00080000:3.0:1788791973.663735:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788791973.663744:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788791973.663747:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788791973.665116:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760552704 00000100:00100000:2.0:1788791973.665133:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760552704 00000100:00100000:2.0:1788791973.665251:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 173 00000100:00100000:2.0:1788791973.665262:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6143910450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45e61654-910c-4348-9ed1-eb146143af9d+13:2422:x1875683760552704:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788791973.665365:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6143910450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45e61654-910c-4348-9ed1-eb146143af9d+13:2422:x1875683760552704:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 105us (6212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791973.665373:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 173 00000100:00100000:1.0:1788791973.910079:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788791973.910104:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c614f4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785799936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788791973.910135:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791973.910150:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785800064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788791973.910188:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791973.910193:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791973.910259:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785800064 00000100:00100000:2.0:1788791973.910266:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785800064 00000100:00100000:2.0:1788791973.910334:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788791973.910344:0:18607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785800064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788791973.910372:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788791973.910491:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785799936 00000100:00100000:0.0:1788791973.910497:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785799936 00000100:00100000:0.0:1788791973.910529:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788791973.910537:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614f4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785799936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788791973.910576:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00080000:3.0:1788791973.911041:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791973.911498:0:18607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785800064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1153us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791973.911512:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788791973.911597:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785800064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788791973.914714:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614f4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785799936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4167us (4516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791973.914730:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788791973.915648:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c614f4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785799936:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788791974.102395:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791974.299018:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788791974.299989:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760553600 00000100:00100000:2.0:1788791974.300002:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760553600 00000100:00100000:2.0:1788791974.300122:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:2.0:1788791974.300134:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:803e9a46-551b-4171-b661-e561c059a809+13:16364:x1875683760553600:12345-192.168.201.20@tcp:35:umount.0 00000001:00080000:2.0:1788791974.300456:0:17100:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:2.0:1788791974.300620:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:803e9a46-551b-4171-b661-e561c059a809+15:16364:x1875683760553600:12345-192.168.201.20@tcp:35:umount.0 Request processed in 486us (1612us total) trans 8589934625 rc 0/0 00000100:00100000:2.0:1788791974.300628:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000020:00080000:2.0:1788791974.300633:0:17100:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788791974.315205:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788791974.315270:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788791974.315390:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760553856 00000100:00100000:3.0:1788791974.315400:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760553856 00000100:00100000:3.0:1788791974.315466:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760553728 00000100:00100000:3.0:1788791974.315470:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760553728 00000100:00100000:3.0:1788791974.315500:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:3.0:1788791974.315509:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614f4a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45e61654-910c-4348-9ed1-eb146143af9d+14:2419:x1875683760553856:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791974.315525:0:20238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791974.315544:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6175ee8800/0x4d37c11031f35e45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c673e1 expref: 14 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791974.315560:0:20238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791974.315608:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614f4a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45e61654-910c-4348-9ed1-eb146143af9d+13:2419:x1875683760553856:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 102us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791974.315613:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:3.0:1788791974.315626:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:3.0:1788791974.315630:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043e19850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45e61654-910c-4348-9ed1-eb146143af9d+12:2419:x1875683760553728:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791974.315635:0:20238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791974.315640:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6175ee9000/0x4d37c11031f35e3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c673b0 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791974.315647:0:20238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791974.315673:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043e19850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45e61654-910c-4348-9ed1-eb146143af9d+11:2419:x1875683760553728:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 43us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791974.315677:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:0.0:1788791974.316563:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788791974.316641:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760553984 00000100:00100000:3.0:1788791974.316648:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760553984 00000100:00100000:3.0:1788791974.316723:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:3.0:1788791974.316732:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60425d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45e61654-910c-4348-9ed1-eb146143af9d+11:2420:x1875683760553984:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791974.316742:0:20238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791974.316755:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c617b953e00/0x4d37c11031f35eca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67497 expref: 11 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791974.316767:0:20238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791974.316810:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60425d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45e61654-910c-4348-9ed1-eb146143af9d+10:2420:x1875683760553984:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 80us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791974.316817:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:0.0:1788791974.320637:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788791974.320803:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760554112 00000100:00100000:1.0:1788791974.320966:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760554112 00000100:00100000:1.0:1788791974.321131:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:1.0:1788791974.321142:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:803e9a46-551b-4171-b661-e561c059a809+5:2418:x1875683760554112:12345-192.168.201.20@tcp:9:umount.0 00000020:00000080:1.0:1788791974.321185:0:18605:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35e68 00000100:00080000:1.0:1788791974.321196:0:18605:0:(import.c:65:import_set_state_nolock()) ffff8c618122b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788791974.321309:0:18605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00010000:00010000:3.0:1788791974.321538:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791974.321613:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:803e9a46-551b-4171-b661-e561c059a809+2:2418:x1875683760554112:12345-192.168.201.20@tcp:9:umount.0 Request processed in 472us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791974.321634:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:2.0:1788791974.338289:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788791974.338477:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760555008 00000100:00100000:0.0:1788791974.338489:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760555008 00000100:00100000:0.0:1788791974.338618:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:0.0:1788791974.338629:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:803e9a46-551b-4171-b661-e561c059a809+15:2418:x1875683760555008:12345-192.168.201.20@tcp:39:umount.0 00000020:00000080:0.0:1788791974.338664:0:17097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35e53 00000020:00010000:0.0:1788791974.338683:0:17097:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c61812b6800: total 0 00000100:00080000:0.0:1788791974.338688:0:17097:0:(import.c:65:import_set_state_nolock()) ffff8c61812b3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788791974.338717:0:17097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000020:00010000:3.0:1788791974.338952:0:17084:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c61812b6800: total 0 00010000:00010000:3.0:1788791974.338957:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791974.339029:0:17084:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c61812b6800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788791974.339079:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6159de3000) 00010000:00010000:3.0:1788791974.339092:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788791974.339101:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f35f79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c674b3 expref: 15 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791974.339125:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c6042485c00) 00010000:00010000:3.0:1788791974.339128:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788791974.339132:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c617b952000/0x4d37c11031f36108 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67531 expref: 14 pid: 19939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791974.339172:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c6170daf400) 00010000:00010000:3.0:1788791974.339175:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788791974.339179:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6181363c00/0x4d37c11031f3616a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67554 expref: 13 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791974.339194:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c6159de3c00) 00010000:00010000:3.0:1788791974.339196:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788791974.339201:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688200/0x4d37c11031f35f1e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6749e expref: 12 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791974.339380:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c6159de3600) 00010000:00010000:3.0:1788791974.339383:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788791974.339388:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c617b952800/0x4d37c11031f35ffe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c674dd expref: 11 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791974.339402:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c6170daf400) 00010000:00010000:3.0:1788791974.339404:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788791974.339408:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f360ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6751c expref: 10 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791974.339418:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c6170daf400) 00010000:00010000:3.0:1788791974.339420:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788791974.339424:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c617b952600/0x4d37c11031f3607c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67507 expref: 9 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791974.339438:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c6170daf500) 00010000:00010000:3.0:1788791974.339447:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791974.339451:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee9400/0x4d37c11031f35f3a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c674a5 expref: 8 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791974.339465:0:17084:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c61812b6800, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1788791974.339479:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791974.339481:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791974.339483:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791974.339767:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:803e9a46-551b-4171-b661-e561c059a809+5:2418:x1875683760555008:12345-192.168.201.20@tcp:39:umount.0 Request processed in 1139us (1487us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1788791974.339777:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:0.0:1788791974.352340:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788791974.352447:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760555136 00000100:00100000:1.0:1788791974.352463:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760555136 00000100:00100000:1.0:1788791974.352670:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:1.0:1788791974.352694:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:803e9a46-551b-4171-b661-e561c059a809+5:2418:x1875683760555136:12345-192.168.201.20@tcp:39:umount.0 00000020:00000080:1.0:1788791974.352739:0:17096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35e5a 00000100:00080000:1.0:1788791974.352762:0:17096:0:(import.c:65:import_set_state_nolock()) ffff8c6153960000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788791974.352798:0:17096:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788791974.353147:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:803e9a46-551b-4171-b661-e561c059a809+3:2418:x1875683760555136:12345-192.168.201.20@tcp:39:umount.0 Request processed in 465us (817us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788791974.353155:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 68 00010000:00010000:0.0:1788791974.353710:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791974.422148:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c614f4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785800192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788791974.422309:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791974.422602:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785800192 00000100:00100000:0.0:1788791974.422612:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785800192 00000100:00100000:0.0:1788791974.422705:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788791974.422717:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785800192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788791974.422753:0:17102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788791974.422809:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785800192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791974.422829:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788791974.422935:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c614f4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785800192:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788791975.126314:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791975.698037:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788791975.698085:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788791975.698113:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788791975.698162:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760555392 00000100:00100000:2.0:1788791975.698176:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760555392 00000100:00100000:0.0:1788791975.698205:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760555264 00000100:00100000:0.0:1788791975.698211:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760555264 00000100:00100000:2.0:1788791975.698251:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760555520 00000100:00100000:2.0:1788791975.698256:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760555520 00000100:00100000:1.0:1788791975.708364:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:1.0:1788791975.708396:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45e61654-910c-4348-9ed1-eb146143af9d+12:2421:x1875683760555392:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791975.708420:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791975.708446:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6175ee8000/0x4d37c11031f35e84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67451 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791975.708465:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791975.708536:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45e61654-910c-4348-9ed1-eb146143af9d+11:2421:x1875683760555392:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 159us (10524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791975.708544:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:1.0:1788791975.708573:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:1.0:1788791975.708580:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45e61654-910c-4348-9ed1-eb146143af9d+10:2421:x1875683760555264:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791975.708587:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791975.708596:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6175ee9600/0x4d37c11031f35e7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67420 expref: 10 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791975.708619:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791975.708638:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45e61654-910c-4348-9ed1-eb146143af9d+9:2421:x1875683760555264:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 58us (10553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791975.708644:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:1.0:1788791975.708659:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:1.0:1788791975.708666:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45e61654-910c-4348-9ed1-eb146143af9d+8:2421:x1875683760555520:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791975.708674:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791975.708683:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c618217f800/0x4d37c11031f35ec3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67490 expref: 8 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791975.708693:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791975.708709:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45e61654-910c-4348-9ed1-eb146143af9d+7:2421:x1875683760555520:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 44us (10596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791975.708715:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:3.0:1788791975.720506:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788791975.722443:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760555776 00000100:00100000:1.0:1788791975.722457:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760555776 00000100:00100000:1.0:1788791975.722563:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:1.0:1788791975.722575:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f326547c-6736-444b-8513-e15cf2948667+6:2418:x1875683760555776:12345-192.168.201.20@tcp:39:umount.0 00000020:00000080:1.0:1788791975.722622:0:19434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35e92 00000020:00010000:1.0:1788791975.722631:0:19434:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c6042091000: total 0 00000100:00080000:1.0:1788791975.722637:0:19434:0:(import.c:65:import_set_state_nolock()) ffff8c6042095000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788791975.722681:0:19434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1788791975.722842:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f326547c-6736-444b-8513-e15cf2948667+5:2418:x1875683760555776:12345-192.168.201.20@tcp:39:umount.0 Request processed in 269us (2347us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1788791975.722850:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00080000:3.0:1788791975.723323:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1788791975.723385:0:17084:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c6042091000: total 0 00010000:00010000:0.0:1788791975.723443:0:17084:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c6042091000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788791975.723503:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6159de3000) 00010000:00010000:0.0:1788791975.723507:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788791975.723518:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab000/0x4d37c11031f35f87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c674ba expref: 4 pid: 19434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791975.723545:0:17084:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c6042091000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788791975.723557:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791975.723559:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791975.723566:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791975.734421:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788791975.734516:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760555904 00000100:00100000:0.0:1788791975.734525:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760555904 00000100:00100000:0.0:1788791975.734598:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:0.0:1788791975.734610:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614f4a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f326547c-6736-444b-8513-e15cf2948667+5:2418:x1875683760555904:12345-192.168.201.20@tcp:39:umount.0 00000020:00000080:0.0:1788791975.734649:0:17097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35e99 00000100:00080000:0.0:1788791975.734657:0:17097:0:(import.c:65:import_set_state_nolock()) ffff8c61812c0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788791975.734686:0:17097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788791975.734843:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614f4a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f326547c-6736-444b-8513-e15cf2948667+3:2418:x1875683760555904:12345-192.168.201.20@tcp:39:umount.0 Request processed in 234us (432us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788791975.734851:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00080000:3.0:1788791975.735125:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788791975.735173:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791975.781348:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788791975.781525:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760556160 00000100:00100000:1.0:1788791975.781539:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760556160 00000100:00100000:1.0:1788791975.781646:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 174 00000100:00100000:1.0:1788791975.781658:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614329ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45e61654-910c-4348-9ed1-eb146143af9d+7:2418:x1875683760556160:12345-192.168.201.20@tcp:251:umount.0 00000020:00000080:1.0:1788791975.781703:0:17088:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35e30 00000020:00010000:1.0:1788791975.781711:0:17088:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c604377a800: total 0 00000100:00080000:1.0:1788791975.781716:0:17088:0:(import.c:65:import_set_state_nolock()) ffff8c604377e800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788791975.781802:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614329ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45e61654-910c-4348-9ed1-eb146143af9d+3:2418:x1875683760556160:12345-192.168.201.20@tcp:251:umount.0 Request processed in 146us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791975.781810:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 174 00000020:00010000:2.0:1788791975.782174:0:17085:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c604377a800: total 0 00010000:00010000:2.0:1788791975.782242:0:17085:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c604377a800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788791975.782288:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6141689600/0x4d37c11031f35e37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c673a9 expref: 2 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791975.782306:0:17085:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c604377a800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788791975.782317:0:17085:0:(genops.c:885:class_export_put()) final put ffff8c604377a800/45e61654-910c-4348-9ed1-eb146143af9d 00010000:00010000:2.0:1788791975.782350:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791975.782353:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791975.782354:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788791975.782460:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c604377a800/45e61654-910c-4348-9ed1-eb146143af9d for MGS 00000020:00000080:3.0:1788791975.782507:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c604377e800 for MGS 00000100:00100000:1.0:1788791975.958071:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791975.958095:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6174cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785800320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788791975.958161:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791975.961188:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785800576:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.961266:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791975.961315:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785801088:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.961343:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791975.961359:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875683785801600:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.961377:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791975.961393:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788791975.961398:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3644:1875683785800448:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.961425:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791975.961445:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875683785800960:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.961463:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791975.961477:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875683785801472:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.961499:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791975.961525:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785800832:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.961549:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791975.961566:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875683785801344:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.961590:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791975.961604:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875683785801856:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.961621:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791975.961636:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788791975.961641:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785800704:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.961659:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791975.961674:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785801216:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.961689:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791975.961703:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875683785801728:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.961719:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791975.961739:0:17811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785800576 00000100:00100000:0.0:1788791975.961752:0:17811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785800576 00000100:00100000:0.0:1788791975.961799:0:17811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785801088 00000100:00100000:0.0:1788791975.961802:0:17811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785801088 00000100:00100000:0.0:1788791975.961822:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788791975.961831:0:17811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785800576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.961924:0:17811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785800576:12345-0@lo:400:kworker.0 Request processed in 94us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791975.961932:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788791975.961948:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788791975.961954:0:17811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785801088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.961983:0:17811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785801088:12345-0@lo:400:kworker.0 Request processed in 30us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791975.961988:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788791975.962008:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785800448 00000100:00100000:0.0:1788791975.962011:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785800448 00000100:00100000:0.0:1788791975.962058:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788791975.962064:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614329fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b5ad001-761f-497e-bfbf-b3c6140a93fd+24:3644:x1875683785800448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962093:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614329fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b5ad001-761f-497e-bfbf-b3c6140a93fd+24:3644:x1875683785800448:12345-0@lo:400:kworker.0 Request processed in 29us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791975.962099:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788791975.962124:0:19939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785801600 00000100:00100000:0.0:1788791975.962127:0:19939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785801600 00000100:00100000:0.0:1788791975.962156:0:19939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785800960 00000100:00100000:0.0:1788791975.962159:0:19939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785800960 00000100:00100000:0.0:1788791975.962169:0:19939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785801472 00000100:00100000:0.0:1788791975.962171:0:19939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785801472 00000100:00100000:0.0:1788791975.962184:0:19939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785801344 00000100:00100000:0.0:1788791975.962185:0:19939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785801344 00000100:00100000:0.0:1788791975.962196:0:19939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785801856 00000100:00100000:0.0:1788791975.962204:0:19939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785801856 00000100:00100000:0.0:1788791975.962219:0:19939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785801728 00000100:00100000:0.0:1788791975.962221:0:19939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785801728 00000100:00100000:0.0:1788791975.962248:0:19939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788791975.962253:0:19939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875683785801600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962279:0:19939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875683785801600:12345-0@lo:400:kworker.0 Request processed in 26us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791975.962284:0:19939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788791975.962293:0:19939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788791975.962297:0:19939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875683785800960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962317:0:19939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875683785800960:12345-0@lo:400:kworker.0 Request processed in 19us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791975.962322:0:19939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788791975.962331:0:19939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788791975.962336:0:19939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875683785801472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962356:0:19939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875683785801472:12345-0@lo:400:kworker.0 Request processed in 20us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791975.962361:0:19939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788791975.962371:0:19939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788791975.962378:0:19939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875683785801344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962405:0:19939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875683785801344:12345-0@lo:400:kworker.0 Request processed in 29us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791975.962411:0:19939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788791975.962421:0:19939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788791975.962425:0:19939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875683785801856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962450:0:19939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875683785801856:12345-0@lo:400:kworker.0 Request processed in 25us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791975.962461:0:19939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788791975.962473:0:19939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788791975.962478:0:19939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875683785801728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962500:0:19939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875683785801728:12345-0@lo:400:kworker.0 Request processed in 23us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791975.962505:0:19939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788791975.962523:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785800832 00000100:00100000:0.0:1788791975.962526:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785800832 00000100:00100000:0.0:1788791975.962552:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785800704 00000100:00100000:0.0:1788791975.962555:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785800704 00000100:00100000:0.0:1788791975.962565:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785801216 00000100:00100000:0.0:1788791975.962567:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785801216 00000100:00100000:0.0:1788791975.962578:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788791975.962583:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785800832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962610:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785800832:12345-0@lo:400:kworker.0 Request processed in 27us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791975.962616:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788791975.962625:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788791975.962630:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785800704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962650:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785800704:12345-0@lo:400:kworker.0 Request processed in 20us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791975.962655:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788791975.962663:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788791975.962667:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785801216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962685:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785801216:12345-0@lo:400:kworker.0 Request processed in 18us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791975.962698:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788791975.962715:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788791975.962719:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788791975.962721:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788791975.962722:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788791975.962757:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785800704:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962766:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785801216:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962773:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875683785801728:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962781:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785800832:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962788:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875683785801344:0@lo:400:kworker.0 00010000:00080000:0.0:1788791975.962798:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6043709c00 x1875683785801856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791975.962808:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875683785801856:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962849:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3644:1875683785800448:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962858:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875683785800960:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962867:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875683785801472:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962899:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785801088:0@lo:400:kworker.0 00010000:00080000:0.0:1788791975.962908:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c61608c1880 x1875683785801600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791975.962917:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875683785801600:0@lo:400:kworker.0 00000100:00100000:0.0:1788791975.962926:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785800576:0@lo:400:kworker.0 00000100:00100000:3.0:1788791975.963137:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785800320 00000100:00100000:3.0:1788791975.963142:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785800320 00000100:00100000:3.0:1788791975.963173:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788791975.963179:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785800320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788791975.963203:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788791975.963244:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785800320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (5083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791975.963250:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788791975.963269:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785801984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791975.963297:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791975.963326:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785801984 00000100:00100000:3.0:1788791975.963329:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785801984 00000100:00100000:3.0:1788791975.963349:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788791975.963354:0:18607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785801984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788791975.963362:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788791975.963387:0:18607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785801984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791975.963393:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788791975.963404:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788791975.963423:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785801984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791975.963454:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6174cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785800320:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788791976.150088:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791977.174749:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788791977.979837:0:20670:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000100:00100000:0.0:1788791978.013780:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785802112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791978.013943:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788791978.014224:0:20670:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788791978.014277:0:20670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6140031600/0x4d37c11031f359f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f359fa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.014290:0:20670:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6140031600/0x4d37c11031f359f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f359fa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.014298:0:20670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6140031600/0x4d37c11031f359f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f359fa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.014305:0:20670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c6140031600/0x4d37c11031f359f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f359fa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.014332:0:20670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788791978.014338:0:20670:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788791978.014367:0:20670:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788791978.014371:0:20670:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788791978.014378:0:20670:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788791978.014392:0:20670:0:(import.c:65:import_set_state_nolock()) ffff8c6143575000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788791978.015524:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791978.015534:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c6140031600/0x4d37c11031f359f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f359fa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791978.015544:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140031600 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:0.0:1788791978.015547:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c6140031600/0x4d37c11031f359f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f359fa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791978.015557:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c6140031600/0x4d37c11031f359f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f359fa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791978.015565:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c6140031600/0x4d37c11031f359f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f359fa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791978.015571:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788791978.015574:0:17085:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788791978.015577:0:17085:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788791978.015607:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c6140031600/0x4d37c11031f359f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f359fa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791978.015614:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788791978.015643:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c6140031600/0x4d37c11031f359f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f359fa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791978.015651:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c6140031600/0x4d37c11031f359f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f359fa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791978.015684:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791978.015686:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791978.015688:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791978.015704:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875683785802240:0@lo:39:umount.0 00000100:00100000:0.0:1788791978.016356:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791978.016596:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785802112 00000100:00100000:3.0:1788791978.016605:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785802112 00000100:00100000:3.0:1788791978.016718:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788791978.016729:0:18607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785802112:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791978.017052:0:19939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785802240 00000100:00100000:1.0:1788791978.017058:0:19939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785802240 00000100:00100000:2.0:1788791978.017198:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3641:1875683785802368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791978.017271:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788791978.029714:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788791978.029907:0:18607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785802112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13145us (15928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791978.029926:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788791978.031299:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788791978.031339:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785802368 00000100:00100000:3.0:1788791978.031350:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785802368 00000100:00100000:3.0:1788791978.031921:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788791978.031933:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043709f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1b5ad001-761f-497e-bfbf-b3c6140a93fd+24:3641:x1875683785802368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788791978.031950:0:20238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791978.031972:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6140031e00/0x4d37c11031f359fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f359f3 expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791978.032003:0:20238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791978.032090:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043709f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1b5ad001-761f-497e-bfbf-b3c6140a93fd+23:3641:x1875683785802368:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (14819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791978.032098:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788791978.032163:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785802112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791978.035679:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3641:1875683785802368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791978.035934:0:19939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788791978.035950:0:19939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875683785802240:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788791978.035991:0:19939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35a24 00000100:00080000:1.0:1788791978.036001:0:19939:0:(import.c:65:import_set_state_nolock()) ffff8c6171396800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788791978.036116:0:19939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1875683785802240:12345-0@lo:39:umount.0 Request processed in 172us (19760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791978.036123:0:19939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1788791978.036136:0:19939:0:(genops.c:885:class_export_put()) final put ffff8c617f9ba000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788791978.036302:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6143575000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788791978.036314:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875683785802240:0@lo:39:umount.0 00000100:00080000:2.0:1788791978.036351:0:20670:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788791978.036354:0:20670:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788791978.036359:0:20670:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788791978.037313:0:20670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8400/0x4d37c11031f35944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3594b expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037329:0:20670:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8400/0x4d37c11031f35944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f3594b expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037338:0:20670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8400/0x4d37c11031f35944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f3594b expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037346:0:20670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8400/0x4d37c11031f35944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f3594b expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037368:0:20670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791978.037382:0:18630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791978.037388:0:18630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8400/0x4d37c11031f35944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f3594b expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037395:0:18630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6175ee8400 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:2.0:1788791978.037399:0:18630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8400/0x4d37c11031f35944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f3594b expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037408:0:18630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8400/0x4d37c11031f35944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f3594b expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791978.037416:0:18630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8400/0x4d37c11031f35944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f3594b expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791978.037435:0:18630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788791978.037437:0:18630:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788791978.037467:0:18630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8400/0x4d37c11031f35944 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f3594b expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037474:0:18630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791978.037490:0:18630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8400/0x4d37c11031f35944 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f3594b expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037497:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8400/0x4d37c11031f35944 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f3594b expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037511:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791978.037512:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791978.037514:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791978.037521:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788791978.037534:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3641:1875683785802496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791978.037587:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788791978.037638:0:20670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430af800/0x4d37c11031f35d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f35d5e expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037646:0:20670:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430af800/0x4d37c11031f35d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f35d5e expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037652:0:20670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430af800/0x4d37c11031f35d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35d5e expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037658:0:20670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c60430af800/0x4d37c11031f35d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35d5e expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037682:0:20670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791978.037688:0:20670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6140031400/0x4d37c11031f35efb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f35f02 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037694:0:20670:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6140031400/0x4d37c11031f35efb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f35f02 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037700:0:20670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6140031400/0x4d37c11031f35efb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35f02 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037707:0:20670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c6140031400/0x4d37c11031f35efb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35f02 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037718:0:20670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788791978.037726:0:18630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788791978.037730:0:18630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c60430af800/0x4d37c11031f35d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35d5e expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037736:0:18630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c60430af800 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:2.0:1788791978.037739:0:18630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c60430af800/0x4d37c11031f35d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35d5e expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037746:0:18630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c60430af800/0x4d37c11031f35d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f35d5e expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791978.037752:0:18630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c60430af800/0x4d37c11031f35d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f35d5e expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791978.037758:0:18630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788791978.037765:0:18630:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788791978.037768:0:18630:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788791978.037784:0:18630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c60430af800/0x4d37c11031f35d57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35d5e expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037791:0:18630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791978.037804:0:18630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c60430af800/0x4d37c11031f35d57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35d5e expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037811:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c60430af800/0x4d37c11031f35d57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35d5e expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037820:0:18630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791978.037823:0:18630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c6140031400/0x4d37c11031f35efb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35f02 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037828:0:18630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140031400 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:2.0:1788791978.037831:0:18630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c6140031400/0x4d37c11031f35efb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35f02 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037837:0:18630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c6140031400/0x4d37c11031f35efb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f35f02 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791978.037843:0:18630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c6140031400/0x4d37c11031f35efb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f35f02 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791978.037847:0:18630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788791978.037849:0:18630:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788791978.037851:0:18630:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788791978.037862:0:18630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c6140031400/0x4d37c11031f35efb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35f02 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037899:0:18630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791978.037906:0:18630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c6140031400/0x4d37c11031f35efb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35f02 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037912:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c6140031400/0x4d37c11031f35efb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35f02 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037923:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791978.037925:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791978.037927:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791978.037936:0:20670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8a00/0x4d37c11031f35936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3593d expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037943:0:20670:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8a00/0x4d37c11031f35936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f3593d expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037950:0:20670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8a00/0x4d37c11031f35936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f3593d expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037956:0:20670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8a00/0x4d37c11031f35936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f3593d expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.037968:0:20670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788791978.037972:0:20670:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788791978.037974:0:20670:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788791978.038010:0:18630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791978.038014:0:18630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8a00/0x4d37c11031f35936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f3593d expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.038031:0:18630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6175ee8a00 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:2.0:1788791978.038033:0:18630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8a00/0x4d37c11031f35936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f3593d expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.038039:0:18630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8a00/0x4d37c11031f35936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f3593d expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791978.038044:0:18630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8a00/0x4d37c11031f35936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f3593d expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791978.038048:0:18630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788791978.038050:0:18630:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788791978.038051:0:18630:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788791978.038064:0:18630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8a00/0x4d37c11031f35936 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f3593d expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.038069:0:18630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791978.038078:0:18630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8a00/0x4d37c11031f35936 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f3593d expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.038084:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8a00/0x4d37c11031f35936 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f3593d expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.038093:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791978.038095:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791978.038097:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791978.038107:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3641:1875683785802880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791978.038133:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791978.038168:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785802496 00000100:00100000:2.0:1788791978.038181:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785802496 00000100:00100000:2.0:1788791978.038220:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785802880 00000100:00100000:2.0:1788791978.038223:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785802880 00000100:00100000:2.0:1788791978.038241:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788791978.038249:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b5ad001-761f-497e-bfbf-b3c6140a93fd+24:3641:x1875683785802496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788791978.038259:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791978.038272:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c61413aaa00/0x4d37c11031f3594b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35944 expref: 24 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.038286:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791978.038317:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043708380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b5ad001-761f-497e-bfbf-b3c6140a93fd+23:3641:x1875683785802496:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791978.038324:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788791978.038339:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788791978.038345:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b5ad001-761f-497e-bfbf-b3c6140a93fd+22:3641:x1875683785802880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788791978.038352:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791978.038360:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c61413aa600/0x4d37c11031f3593d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35936 expref: 22 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791978.038368:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791978.038388:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b5ad001-761f-497e-bfbf-b3c6140a93fd+21:3641:x1875683785802880:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791978.038393:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788791978.038450:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3641:1875683785802880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791978.038458:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3641:1875683785802496:0@lo:103:ldlm_bl.0 00000020:01000004:2.0:1788791978.038482:0:20670:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788791978.038485:0:20670:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788791978.038494:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791978.038500:0:20670:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/15 00000020:00080000:2.0:1788791978.038506:0:20670:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c60420b4800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788791978.038512:0:20670:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c6143a8f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788791978.038515:0:20670:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c6043735800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788791978.038519:0:20670:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c6144c17000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788791978.038523:0:20670:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8c617f9ba000 lustre-MDT0000-lwp-MDT0000_UUID 0@lo 0 (0 0 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788791978.038529:0:20670:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8c6042091000 f326547c-6736-444b-8513-e15cf2948667 192.168.201.20@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1788791978.038535:0:20670:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8c61812b6800 803e9a46-551b-4171-b661-e561c059a809 192.168.201.20@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:2.0:1788791978.038539:0:20670:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8c60435319b8) has exports, disconnecting them 00000020:00080000:2.0:1788791978.038544:0:20670:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c60420b4800), last request at 1788791975 00000020:00000080:2.0:1788791978.038550:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35d2d 00000100:00080000:2.0:1788791978.038564:0:20670:0:(import.c:65:import_set_state_nolock()) ffff8c60420b7800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788791978.038599:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788791978.038609:0:20670:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c60420b4800): rc 0 00000020:00000080:2.0:1788791978.038611:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c60420b4800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788791978.038621:0:20670:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c6143a8f000), last request at 1788791975 00000020:00000080:2.0:1788791978.038624:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35bc1 00000100:00080000:2.0:1788791978.038629:0:20670:0:(import.c:65:import_set_state_nolock()) ffff8c6143a8e000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788791978.038638:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788791978.038645:0:20670:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c6143a8f000): rc 0 00000020:00000080:2.0:1788791978.038647:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c6143a8f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788791978.038651:0:20670:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c6043735800), last request at 1788791897 00000020:00000080:2.0:1788791978.038654:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35b12 00000100:00080000:2.0:1788791978.038657:0:20670:0:(import.c:65:import_set_state_nolock()) ffff8c6043736000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788791978.038665:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788791978.038677:0:20670:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c6043735800): rc 0 00000020:00000080:2.0:1788791978.038680:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c6043735800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788791978.038684:0:20670:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c6144c17000), last request at 1788791897 00000020:00000080:2.0:1788791978.038687:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35ab7 00000100:00080000:2.0:1788791978.038691:0:20670:0:(import.c:65:import_set_state_nolock()) ffff8c6144c11000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788791978.038700:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788791978.038706:0:20670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00080000:2.0:1788791978.038782:0:20670:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c6144c17000): rc 0 00000004:00000080:2.0:1788791978.038789:0:20670:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9d26019c3ae0 00000100:00080000:2.0:1788791978.038809:0:20670:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788791978.038812:0:20670:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788791978.039605:0:20670:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788791978.039622:0:20670:0:(import.c:65:import_set_state_nolock()) ffff8c60437f7000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788791978.039653:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785803008:0@lo:39:umount.0 00000100:00100000:2.0:1788791978.039701:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788791978.040325:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791978.040339:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3643:1875683785802624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788791978.040371:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791978.040403:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788791978.040410:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3643:1875683785802752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788791978.040431:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791978.040456:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785802624 00000100:00100000:3.0:1788791978.040462:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785802624 00000100:00100000:3.0:1788791978.040492:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785802752 00000100:00100000:3.0:1788791978.040495:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785802752 00000100:00100000:3.0:1788791978.040510:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788791978.040518:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1b5ad001-761f-497e-bfbf-b3c6140a93fd+22:3643:x1875683785802624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788791978.040528:0:20238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791978.040545:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c60430ae800/0x4d37c11031f35d5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35d57 expref: 22 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791978.040559:0:20238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791978.040600:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1b5ad001-761f-497e-bfbf-b3c6140a93fd+21:3643:x1875683785802624:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791978.040607:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788791978.040622:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788791978.040629:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1b5ad001-761f-497e-bfbf-b3c6140a93fd+20:3643:x1875683785802752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788791978.040636:0:20238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791978.040656:0:20238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6140030a00/0x4d37c11031f35f02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35efb expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791978.040667:0:20238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791978.040689:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1b5ad001-761f-497e-bfbf-b3c6140a93fd+19:3643:x1875683785802752:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791978.040694:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788791978.040913:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3643:1875683785802752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791978.040922:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3643:1875683785802624:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788791978.041406:0:20670:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788791978.041412:0:20670:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1788791978.041467:0:20670:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788791978.041523:0:20670:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788791978.041538:0:20670:0:(import.c:65:import_set_state_nolock()) ffff8c617f977000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788791978.041557:0:20670:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788791978.041559:0:20670:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1788791978.041566:0:20670:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788791978.041622:0:20670:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788791978.041631:0:20670:0:(import.c:65:import_set_state_nolock()) ffff8c6175dae000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788791978.041669:0:20670:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8c60435319b8) has no exports 00000100:00100000:3.0:1788791978.041728:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785803136:0@lo:9:umount.0 00000100:00100000:3.0:1788791978.041767:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791978.041807:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785803264:0@lo:9:umount.0 00000100:00100000:3.0:1788791978.041827:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788791978.042020:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788791978.042032:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c60420b4800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788791978.042087:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6143a8f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788791978.042111:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043735800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788791978.042132:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617f9ba000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1788791978.042372:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785803136 00000100:00100000:2.0:1788791978.042379:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785803136 00000100:00100000:2.0:1788791978.042421:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785803264 00000100:00100000:2.0:1788791978.042425:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785803264 00000100:00100000:2.0:1788791978.042452:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788791978.042459:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875683785803136:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788791978.042481:0:18606:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35c07 00000100:00080000:2.0:1788791978.042489:0:18606:0:(import.c:65:import_set_state_nolock()) ffff8c6042093800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788791978.042522:0:18606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788791978.042683:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3640:x1875683785803136:12345-0@lo:9:umount.0 Request processed in 224us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791978.042690:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788791978.042703:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788791978.042709:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875683785803264:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788791978.042720:0:18606:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35d65 00000100:00080000:2.0:1788791978.042726:0:18606:0:(import.c:65:import_set_state_nolock()) ffff8c61812b0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788791978.042747:0:18606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788791978.042824:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3640:x1875683785803264:12345-0@lo:9:umount.0 Request processed in 114us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791978.042830:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1788791978.042847:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788791978.043169:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c60420b7800 for lustre-MDT0000 00000100:00080000:2.0:1788791978.044023:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788791978.044074:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c617f977000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788791978.044086:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788791978.044089:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788791978.044107:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785803136:0@lo:9:umount.0 00000100:00080000:2.0:1788791978.044122:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6175dae000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788791978.044130:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788791978.044132:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788791978.044134:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785803264:0@lo:9:umount.0 00010000:00010000:3.0:1788791978.044700:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788791978.044763:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6143a8e000 for lustre-MDT0000 00000020:00000080:0.0:1788791978.044772:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6043736000 for lustre-MDT0000 00000020:00000080:0.0:1788791978.044785:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6171396800 for lustre-MDT0000 00000100:00100000:0.0:1788791978.044809:0:17811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785803008 00000100:00100000:0.0:1788791978.044817:0:17811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785803008 00000100:00100000:0.0:1788791978.044869:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788791978.044903:0:17811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875683785803008:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788791978.044931:0:17811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35b3c 00000100:00080000:0.0:1788791978.044941:0:17811:0:(import.c:65:import_set_state_nolock()) ffff8c617bd49000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788791978.044967:0:17811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:3.0:1788791978.045415:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791978.045581:0:17811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3640:x1875683785803008:12345-0@lo:39:umount.0 Request processed in 678us (5877us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788791978.045590:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788791978.045671:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c60437f7000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788791978.045679:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785803008:0@lo:39:umount.0 00000020:00080000:2.0:1788791978.053282:0:20670:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8c60435319b8) has no exports 00000020:00000080:2.0:1788791978.131270:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35991 00000020:00000080:2.0:1788791978.131291:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c617faf3800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788791978.131350:0:20670:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788791978.131491:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791978.131504:0:20670:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788791978.131509:0:20670:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8c6174c9cd28) has no exports 00000020:00000080:3.0:1788791978.131826:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f3598a 00000020:00000080:3.0:1788791978.131832:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c6174eae800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788791978.132556:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617faf3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788791978.138798:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6174eae800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788791978.144351:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791978.144376:0:20670:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788791978.144385:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c6043cd8800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788791978.144392:0:20670:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043cd8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788791978.144403:0:20670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1788791978.198345:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791979.030155:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788791979.030191:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6174cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785803392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788791979.030270:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791979.030666:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785803392 00000100:00100000:1.0:1788791979.030675:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785803392 00000100:00100000:1.0:1788791979.030722:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788791979.030749:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875683785803392:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788791979.030758:0:17101:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788791979.030815:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875683785803392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (545us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788791979.030822:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:02020000:1.0:1788791979.030859:0:3641:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1788791979.034995:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788791979.035033:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785803520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788791979.035115:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791979.035394:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785803520 00000100:00100000:2.0:1788791979.035403:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785803520 00000100:00100000:2.0:1788791979.035476:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788791979.035486:0:18607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785803520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788791979.035510:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788791979.035570:0:18607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785803520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791979.035577:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788791979.036823:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788791979.036922:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785803520:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788791979.046534:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788791979.046558:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8c6042332800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788791979.046563:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788791979.080463:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8c6042332800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788791979.080477:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 540 00000100:00080000:1.0:1788791979.080487:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c6042332800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788791979.080528:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d17100 x1875683785803648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788791979.080795:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785803648:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788791979.080927:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791979.090160:0:17811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785803648 00000100:00100000:1.0:1788791979.090189:0:17811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785803648 00000100:00100000:1.0:1788791979.090490:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788791979.090499:0:17811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875683785803648:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788791979.090528:0:17811:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788791979.136506:0:17811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875683785803648:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 45997us (55568us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788791979.136538:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788791979.138521:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6042332800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788791979.138529:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788791979.138534:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785803648:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1788791979.222145:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788791980.061784:0:17076:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788791980.061794:0:17076:0:(genops.c:885:class_export_put()) final put ffff8c6144c17000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788791980.061902:0:17076:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f326547c-6736-444b-8513-e15cf2948667 00000001:00080000:2.0:1788791980.061923:0:17076:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1788791980.061928:0:17076:0:(genops.c:885:class_export_put()) final put ffff8c6042091000/f326547c-6736-444b-8513-e15cf2948667 00000001:00100000:2.0:1788791980.061935:0:17076:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 803e9a46-551b-4171-b661-e561c059a809 00000001:00080000:2.0:1788791980.061940:0:17076:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:2.0:1788791980.061954:0:17076:0:(genops.c:885:class_export_put()) final put ffff8c61812b6800/803e9a46-551b-4171-b661-e561c059a809 00000020:00000080:0.0:1788791980.062247:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6144c17000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788791980.062315:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6042091000/f326547c-6736-444b-8513-e15cf2948667 for lustre-MDT0000 00000020:00000080:0.0:1788791980.062342:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c61812b6800/803e9a46-551b-4171-b661-e561c059a809 for lustre-MDT0000 00000020:00000080:0.0:1788791980.062365:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6144c11000 for lustre-MDT0000 00000020:00000080:0.0:1788791980.062371:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6042095000 for lustre-MDT0000 00000020:00000080:0.0:1788791980.062374:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c61812b3000 for lustre-MDT0000 00000001:00100000:2.0:1788791980.063776:0:17830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788791980.063790:0:17830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1788791980.063796:0:17830:0:(genops.c:885:class_export_put()) final put ffff8c6153f17800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788791980.063814:0:17830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f326547c-6736-444b-8513-e15cf2948667 00000001:00080000:2.0:1788791980.063818:0:17830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1788791980.063821:0:17830:0:(genops.c:885:class_export_put()) final put ffff8c61812c6800/f326547c-6736-444b-8513-e15cf2948667 00000001:00100000:2.0:1788791980.063841:0:17830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 803e9a46-551b-4171-b661-e561c059a809 00000001:00080000:2.0:1788791980.063849:0:17830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1788791980.063851:0:17830:0:(genops.c:885:class_export_put()) final put ffff8c61812b4800/803e9a46-551b-4171-b661-e561c059a809 00000001:00100000:1.0:1788791980.065691:0:19419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788791980.065700:0:19419:0:(genops.c:885:class_export_put()) final put ffff8c61812b1800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788791980.065713:0:19419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 803e9a46-551b-4171-b661-e561c059a809 00000020:00000080:1.0:1788791980.065716:0:19419:0:(genops.c:885:class_export_put()) final put ffff8c618122d000/803e9a46-551b-4171-b661-e561c059a809 00000020:00000080:0.0:1788791980.065783:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6153f17800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788791980.065848:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c61812c6800/f326547c-6736-444b-8513-e15cf2948667 for lustre-MDT0001 00000020:00000080:0.0:1788791980.066104:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c61812b4800/803e9a46-551b-4171-b661-e561c059a809 for lustre-MDT0001 00000020:00000080:0.0:1788791980.066230:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c61812b1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788791980.070785:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c618122d000/803e9a46-551b-4171-b661-e561c059a809 for lustre-OST0001 00000020:00000080:0.0:1788791980.070836:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c617bd49000 for lustre-MDT0001 00000020:00000080:0.0:1788791980.070842:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c61812c0800 for lustre-MDT0001 00000020:00000080:0.0:1788791980.070846:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6153960000 for lustre-MDT0001 00000020:00000080:0.0:1788791980.070851:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c61812b0000 for lustre-OST0001 00000020:00000080:0.0:1788791980.071361:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c618122b800 for lustre-OST0001 00000020:01000000:3.0:1788791980.182211:0:20670:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c617666b660 - data ffff8c615d89b288/ffff8c6181297000 00000020:01000000:3.0:1788791980.182538:0:20670:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c60436f4600 - data ffff8c616071b870/ffff8c617d7a8800 00000001:00000004:3.0:1788791980.191710:0:20670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000040:00080000:2.0:1788791980.247249:0:17851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788791980.247614:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788791980.297670:0:20670:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788791980.297684:0:20670:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788791980.297704:0:20670:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8c6043709880 x1875683785803008/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788791988 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791980.298079:0:20670:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788791980.302366:0:20670:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788791980.302374:0:20670:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1788791980.302488:0:20670:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788791980.302491:0:20670:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788791980.303149:0:17120:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788791980.303154:0:17120:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788791980.303166:0:17120:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788791980.318089:0:20670:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788791980.318099:0:20670:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1788791980.318121:0:20670:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788791980.318124:0:20670:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788791980.319015:0:17122:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788791980.319021:0:17122:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1788791980.319033:0:17122:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788791980.324514:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35959 00000020:00000080:2.0:1788791980.324527:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c60437f1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788791980.326079:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c60437f1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788791980.329790:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f3596e 00000020:00000080:2.0:1788791980.331165:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c60437f2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788791980.331237:0:20670:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788791980.331247:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791980.331268:0:20670:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788791980.331273:0:20670:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8c6043534d28) has no exports 00000004:01000000:2.0:1788791980.331478:0:20670:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788791980.331488:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f359d0 00000020:00000080:2.0:1788791980.331493:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c617f970800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788791980.337076:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c60437f2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788791980.339922:0:20670:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788791980.340293:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791980.340316:0:20670:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788791980.340322:0:20670:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8c6175c419b8) has no exports 00000020:00000080:3.0:1788791980.340337:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f359c9 00000020:00000080:3.0:1788791980.340348:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c6175dac000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788791980.341357:0:20670:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788791980.341363:0:20670:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788791980.341367:0:20670:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1788791980.341375:0:20670:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788791980.341377:0:20670:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788791980.341537:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791980.341546:0:20670:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788791980.341554:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f359bb 00000020:00000080:3.0:1788791980.341561:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c617c332000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788791980.341566:0:20670:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788791980.341571:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791980.341575:0:20670:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788791980.341578:0:20670:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8c6175c43370) has no exports 00000020:00000080:3.0:1788791980.341584:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f359b4 00000020:00000080:3.0:1788791980.341586:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c617f972800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788791980.343267:0:20670:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788791980.343280:0:20670:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788791980.343283:0:20670:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1788791980.343290:0:20670:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788791980.343293:0:20670:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788791980.343364:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791980.343372:0:20670:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788791980.343536:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617f970800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788791980.343548:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6175dac000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788791980.343554:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6175dae000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788791980.343561:0:8:0:(genops.c:885:class_export_put()) final put ffff8c617c334800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788791980.343564:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617c334800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788791980.343567:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788791980.343665:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617c332000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788791980.343676:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617f972800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788791980.343680:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c617f977000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788791980.343684:0:8:0:(genops.c:885:class_export_put()) final put ffff8c617c330000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788791980.343686:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617c330000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788791980.343690:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788791980.344167:0:20670:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788791980.344176:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f359a6 00000020:00000080:3.0:1788791980.344183:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c617f971800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788791980.344345:0:20670:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788791980.344351:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791980.344357:0:20670:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788791980.344369:0:20670:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8c60424a99b8) has no exports 00000020:00000080:3.0:1788791980.344375:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f3599f 00000020:00000080:3.0:1788791980.344380:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c60437f3800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788791980.348710:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617f971800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00010000:01000000:2.0:1788791980.351134:0:20670:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788791980.351142:0:20670:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788791980.351146:0:20670:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788791980.351153:0:20670:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788791980.351412:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c60437f3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788791980.351593:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791980.351603:0:20670:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788791980.351640:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791980.351643:0:20670:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788791980.351648:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c61435eb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788791980.351651:0:20670:0:(genops.c:844:class_export_destroy()) destroying export ffff8c61435eb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788791980.351659:0:20670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788791980.351772:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35975 00000020:00000080:2.0:1788791980.351780:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c60437f0000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788791980.351786:0:20670:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788791980.351790:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791980.351973:0:20670:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788791980.351979:0:20670:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8c6043533370) has no exports 00000020:00000080:2.0:1788791980.351999:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791980.352003:0:20670:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788791980.352007:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f3597c 00000020:00000080:2.0:1788791980.352011:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c60437f4000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788791980.352020:0:20670:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c6174cad000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788791980.352025:0:20670:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c6174cad000 3 00000020:01000004:2.0:1788791980.352029:0:20670:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c6174cad000 from lustre-MDT0000 00000020:00000080:2.0:1788791980.352048:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791980.352052:0:20670:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788791980.352055:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c60437f5000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788791980.352058:0:20670:0:(genops.c:844:class_export_destroy()) destroying export ffff8c60437f5000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788791980.352065:0:20670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788791980.352098:0:20670:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788791980.352117:0:20670:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788791980.352121:0:20670:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788791980.352124:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791980.352127:0:20670:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788791980.352133:0:20670:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8c6043e97800 1b5ad001-761f-497e-bfbf-b3c6140a93fd 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788791980.352139:0:20670:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8c6175c44d28) has exports, disconnecting them 00000020:00080000:2.0:1788791980.352144:0:20670:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8c6043e97800), last request at 1788791880 00000020:00000080:2.0:1788791980.352161:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35921 00000020:00010000:2.0:1788791980.352166:0:20670:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c6043e97800: total 2 00000100:00080000:2.0:1788791980.352170:0:20670:0:(import.c:65:import_set_state_nolock()) ffff8c6043e93000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788791980.352186:0:20670:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c6043e97800): rc 0 00000020:00080000:2.0:1788791980.352191:0:20670:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8c6175c44d28) has no exports 00000020:00010000:2.0:1788791980.352204:0:18630:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c6043e97800: total 2 00010000:00010000:2.0:1788791980.352207:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791980.352232:0:18630:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c6043e97800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788791980.352276:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c60430afc00/0x4d37c11031f35b82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35b7b expref: 14 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791980.352293:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c60430aec00/0x4d37c11031f35d11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35d0a expref: 13 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791980.352305:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6175ee8600/0x4d37c11031f35d50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35d49 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791980.352322:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6175ee9800/0x4d37c11031f35a40 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35a39 expref: 11 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791980.352334:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6175ee9c00/0x4d37c11031f35bac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35ba5 expref: 10 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791980.352345:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c618217fe00/0x4d37c11031f35ed8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35ed1 expref: 9 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791980.352367:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c61413aba00/0x4d37c11031f35afd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35af6 expref: 8 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791980.352381:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6140031800/0x4d37c11031f35a4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35a47 expref: 7 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791980.352570:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c60430ae000/0x4d37c11031f3592f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35928 expref: 6 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791980.352582:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6140031200/0x4d37c11031f35ef4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35eed expref: 5 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791980.352593:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c60430ae200/0x4d37c11031f35ce7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35ce0 expref: 4 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791980.352603:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c618217ec00/0x4d37c11031f35ee6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35edf expref: 3 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791980.352617:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6140031c00/0x4d37c11031f35a5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4d37c11031f35a55 expref: 2 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791980.352628:0:18630:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c6043e97800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788791980.352734:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c60437f7000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788791980.352742:0:8:0:(genops.c:885:class_export_put()) final put ffff8c617faf6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788791980.352744:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617faf6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788791980.352749:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788791980.353031:0:18630:0:(genops.c:885:class_export_put()) final put ffff8c6043e97800/1b5ad001-761f-497e-bfbf-b3c6140a93fd 00010000:00010000:2.0:1788791980.353047:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791980.353049:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791980.353051:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788791980.353137:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c60437f0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788791980.353142:0:8:0:(genops.c:885:class_export_put()) final put ffff8c60437f3000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788791980.353144:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c60437f3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788791980.353148:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788791980.353180:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c60437f4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788791980.353185:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043e97800/1b5ad001-761f-497e-bfbf-b3c6140a93fd for MGS 00000020:00000080:1.0:1788791980.353201:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6043e93000 for MGS 00000100:00100000:1.0:1788791980.353235:0:17088:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8c60430c9800:17088] 0 exiting: rc = 1 00000100:00100000:1.0:1788791980.353460:0:17089:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8c60430c9000:17089] 1 exiting: rc = 0 00000100:00100000:1.0:1788791980.353534:0:17090:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8c60430c8000:17090] 2 exiting: rc = 0 00000100:00100000:2.0:1788791980.354649:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354659:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354666:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354672:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354687:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354694:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354700:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354706:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354712:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354719:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354724:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354730:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354735:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354742:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354748:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354753:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354759:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354764:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354770:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354777:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354782:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354787:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.354792:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355046:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355052:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355056:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355062:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355068:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355073:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355077:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355083:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355088:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355093:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355098:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355104:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355109:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355115:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355120:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355126:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355138:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355143:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355148:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355153:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355157:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355162:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355168:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355173:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355177:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355182:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355187:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355192:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355197:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355202:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355207:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355212:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355217:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355223:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355228:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355233:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355237:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355242:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355247:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355252:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791980.355370:0:20670:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788791980.357712:0:20670:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c6175e1e480 - data ffff8c6149069bd0/ffff8c604211b000 00000020:01000000:2.0:1788791980.357903:0:20670:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c6044434c60 - data ffff8c615d8035e8/ffff8c617bb06000 00000020:00000080:2.0:1788791980.358791:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35905 00000020:00000080:2.0:1788791980.358855:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c6043f3a800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788791980.358949:0:20670:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c6174cad000 from MGS, refs=2 00000020:01000004:2.0:1788791980.358954:0:20670:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c6174cad000 2 00000020:01000004:2.0:1788791980.358959:0:20670:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c6174cad000 from MGS 00000020:00000080:2.0:1788791980.358998:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791980.359006:0:20670:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788791980.359025:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c6043f3b000/MGS 00000020:00000080:2.0:1788791980.359027:0:20670:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043f3b000/MGS for MGS 00000020:01000000:2.0:1788791980.359035:0:20670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788791980.359115:0:20670:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788791980.359118:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791980.359124:0:20670:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788791980.359131:0:20670:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8c6143570800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788791980.359136:0:20670:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8c60424ab370) has exports, disconnecting them 00000020:00080000:2.0:1788791980.359142:0:20670:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8c6143570800), last request at 1788791881 00000020:00000080:2.0:1788791980.359146:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35a08 00000020:00080000:2.0:1788791980.359157:0:20670:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c6143570800): rc 0 00000020:00000080:2.0:1788791980.359162:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c6143570800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788791980.360174:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043f3a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788791980.361895:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6143570800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788791980.397945:0:20670:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788791980.397957:0:20670:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788791980.397962:0:20670:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788791980.397970:0:20670:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788791980.398015:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6143575000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788791980.398187:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788791980.398195:0:20670:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788791980.398201:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c6143572000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788791980.398205:0:20670:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6143572000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788791980.398213:0:20670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788791980.398323:0:20670:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c6174cad000 1 00000020:00000080:1.0:1788791980.398332:0:20670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f358f7 00000020:00000080:1.0:1788791980.398340:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c6043f39800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788791980.398350:0:20670:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788791980.398360:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043f39800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788791980.398370:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788791980.398376:0:20670:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788791980.398380:0:20670:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8c6043530000) has no exports 00000020:00000080:0.0:1788791980.539029:0:20670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791980.539043:0:20670:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788791980.539049:0:20670:0:(genops.c:885:class_export_put()) final put ffff8c6174cab000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788791980.539054:0:20670:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6174cab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788791980.539067:0:20670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788791980.539234:0:20670:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c6174cac000 00000020:02000400:0.0:1788791980.539324:0:20670:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:1.0:1788791981.079349:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788791981.079356:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788791981.079360:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c6042332800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788791981.079367:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 622 00000100:00080000:1.0:1788791981.079383:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788791981.079390:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c6042332800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788791981.079413:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d14380 x1875683785803904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788791981.079500:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3644:1875683785803776:0@lo:400:kworker.0 00000400:00000100:1.0:1788791981.079553:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875683785803776 offset 0 length 224: 4 00000100:00100000:1.0:1788791981.079592:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875683785804416:0@lo:400:kworker.0 00000100:00100000:1.0:1788791981.079625:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791981.079656:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788791981.079679:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875683785804288:0@lo:400:kworker.0 00000100:00100000:1.0:1788791981.079703:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791981.079721:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875683785804800:0@lo:400:kworker.0 00000100:00100000:1.0:1788791981.079742:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791981.079771:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785803904:0@lo:38:kworker.0 00000100:00100000:1.0:1788791981.079796:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791981.079830:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785804032:0@lo:400:kworker.0 00000100:00100000:1.0:1788791981.079993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791981.080013:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875683785804544:0@lo:400:kworker.0 00000100:00100000:1.0:1788791981.080035:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791981.080055:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788791981.080060:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785804160:0@lo:400:kworker.0 00000100:00100000:1.0:1788791981.080080:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791981.080161:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875683785804672:0@lo:400:kworker.0 00000100:00100000:1.0:1788791981.080182:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791981.080216:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785804416 00000100:00100000:1.0:1788791981.080224:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785804416 00000100:00100000:1.0:1788791981.080254:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785804288 00000100:00100000:1.0:1788791981.080257:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785804288 00000100:00100000:1.0:1788791981.080267:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785804800 00000100:00100000:1.0:1788791981.080270:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785804800 00000100:00100000:1.0:1788791981.080300:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785804544 00000100:00100000:1.0:1788791981.080303:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785804544 00000100:00100000:1.0:1788791981.080318:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785804672 00000100:00100000:1.0:1788791981.080320:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785804672 00000100:00100000:1.0:1788791981.080333:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788791981.080342:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875683785804800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791981.080996:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875683785804800:12345-0@lo:400:kworker.0 Request processed in 653us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791981.081005:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788791981.081023:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788791981.081030:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875683785804544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791981.081065:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875683785804544:12345-0@lo:400:kworker.0 Request processed in 35us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791981.081071:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788791981.081084:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788791981.082174:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875683785804416:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788791981.082183:0:19434:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788791981.082228:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875683785804416:12345-0@lo:400:kworker.0 Request processed in 1138us (2603us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788791981.082236:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788791981.082256:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788791981.082262:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875683785804288:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788791981.082267:0:19434:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788791981.082289:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875683785804288:12345-0@lo:400:kworker.0 Request processed in 26us (2585us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788791981.082294:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788791981.082303:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788791981.082307:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1875683785804672:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788791981.082311:0:19434:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788791981.082329:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1875683785804672:12345-0@lo:400:kworker.0 Request processed in 21us (2147us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788791981.082334:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788791981.082394:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785803904 00000100:00100000:1.0:1788791981.082402:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785803904 00000100:00100000:1.0:1788791981.082429:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788791981.082434:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875683785803904:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788791981.082451:0:17102:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788791981.088441:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785804032 00000100:00100000:0.0:1788791981.088458:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785804032 00000100:00100000:0.0:1788791981.088533:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785804160 00000100:00100000:0.0:1788791981.088538:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785804160 00000100:00100000:0.0:1788791981.088576:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788791981.088586:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785804032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791981.088727:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785804032:12345-0@lo:400:kworker.0 Request processed in 143us (8734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791981.088734:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788791981.088748:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788791981.088754:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785804160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791981.088779:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785804160:12345-0@lo:400:kworker.0 Request processed in 26us (8698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791981.088785:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788791981.094452:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788791981.094462:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788791981.094465:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788791981.094517:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785804160:0@lo:400:kworker.0 00000100:00080000:0.0:1788791981.094532:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788791981.094536:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8c60420b7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788791981.094539:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788791981.108244:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785804928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788791981.108327:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788791981.108386:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788791981.108391:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8c6175f25000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788791981.108396:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788791981.108401:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8c6175f25000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788791981.108405:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 540 00000100:00080000:3.0:1788791981.108412:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c6175f25000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788791981.108441:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6151f4e680 x1875683785805056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788791981.108473:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875683785804288:0@lo:400:kworker.0 00010000:00080000:3.0:1788791981.108552:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043d16300 x1875683785804800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791981.108564:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875683785804800:0@lo:400:kworker.0 00000100:00080000:3.0:1788791981.108579:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788791981.108594:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8c604353c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788791981.108598:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788791981.108601:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8c604353c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788791981.108605:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 557 00000100:00080000:3.0:1788791981.108609:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c604353c000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788791981.108623:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6151f4ca80 x1875683785805184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788791981.108634:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875683785804416:0@lo:400:kworker.0 00000100:00100000:2.0:1788791981.109272:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785804928 00000100:00100000:2.0:1788791981.109281:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785804928 00000100:00100000:2.0:1788791981.109336:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788791981.109347:0:18607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785804928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788791981.109393:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788791981.109448:0:18607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785804928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791981.109455:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788791981.109498:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785804928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788791981.111101:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875683785805056:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788791981.111168:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791981.111216:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875683785805184:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788791981.111238:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791981.111753:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785805056 00000100:00100000:3.0:1788791981.111761:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785805056 00000100:00100000:3.0:1788791981.111800:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785805184 00000100:00100000:3.0:1788791981.111803:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785805184 00000100:00100000:3.0:1788791981.111828:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788791981.111835:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875683785805056:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1788791981.111857:0:19434:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788791981.111939:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875683785805056:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 102us (769us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788791981.111947:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788791981.111979:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788791981.111983:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875683785805184:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1788791981.111993:0:19434:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788791981.112018:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875683785805184:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 33us (779us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788791981.112024:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788791981.112035:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6175f25000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788791981.112041:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788791981.112052:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875683785805056:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788791981.112065:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c604353c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788791981.112069:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788791981.112072:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875683785805184:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1788791981.139187:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8c60420b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788791981.139199:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 573 00000100:00080000:0.0:1788791981.139208:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c60420b7000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788791981.139256:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043dcb480 x1875683785805312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788791981.139310:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875683785804672:0@lo:400:kworker.0 00000100:00100000:0.0:1788791981.139354:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785804032:0@lo:400:kworker.0 00010000:00080000:0.0:1788791981.139367:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043d15f80 x1875683785804544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791981.139397:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875683785804544:0@lo:400:kworker.0 00000100:00100000:3.0:1788791981.139438:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875683785805312:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788791981.139512:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791981.142019:0:19939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785805312 00000100:00100000:0.0:1788791981.142034:0:19939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785805312 00000100:00100000:3.0:1788791981.142122:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788791981.142132:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875683785805312:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788791981.142159:0:17096:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788791981.142244:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875683785805312:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 111us (2732us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788791981.142252:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788791981.143116:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c60420b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788791981.143122:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788791981.143126:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875683785805312:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788791981.175615:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875683785803904:12345-0@lo:38:kworker.0 Request processed in 93169us (95806us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788791981.175631:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788791981.175752:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6042332800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788791981.175758:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788791981.175762:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785803904:0@lo:38:kworker.0 00010000:00010000:3.0:1788791981.274192:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791982.297073:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791983.332564:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791984.150560:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788791984.150595:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785805440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788791984.150663:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791984.150707:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785805440 00000100:00100000:2.0:1788791984.150715:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785805440 00000100:00100000:2.0:1788791984.150770:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788791984.150779:0:18607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604370ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785805440:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788791984.150965:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788791984.151091:0:18607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788791984.151245:0:18607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604370ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785805440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 466us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791984.151252:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788791984.151331:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785805440:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1788791984.166211:0:18600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788791984.166221:0:18600:0:(genops.c:885:class_export_put()) final put ffff8c6042094800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788791984.166279:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6042094800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788791984.166324:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6042093800 for lustre-OST0000 00010000:00010000:1.0:1788791984.361774:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791985.366257:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791986.207441:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791986.207465:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785805568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788791986.207556:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791986.207623:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785805568 00000100:00100000:1.0:1788791986.207632:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785805568 00000100:00100000:1.0:1788791986.207689:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788791986.207700:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785805568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788791986.207730:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788791986.207773:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785805568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791986.207781:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788791986.207803:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788791986.207853:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785805568:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788791986.208428:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788791986.208433:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788791986.208436:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c6042332800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788791986.208441:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 624 00000100:00080000:3.0:1788791986.208445:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788791986.208449:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c6042332800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788791986.208480:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6151f4e680 x1875683785805824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788791986.208514:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788791986.208517:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788791986.208519:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c6175f25000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788791986.208522:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 624 00000100:00080000:3.0:1788791986.208536:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788791986.208540:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c6175f25000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788791986.208553:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6151f4f100 x1875683785806080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788791986.208563:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788791986.208565:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788791986.208567:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c604353c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788791986.208570:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 624 00000100:00080000:3.0:1788791986.208573:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788791986.208576:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c604353c000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788791986.208586:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6151f4f480 x1875683785806208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788791986.208604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788791986.208607:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788791986.208608:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c60420b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788791986.208612:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 624 00000100:00080000:3.0:1788791986.208614:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788791986.208617:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c60420b7000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788791986.208627:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6151f4c000 x1875683785806464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788791986.208655:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785805824:0@lo:38:kworker.0 00000100:00100000:3.0:1788791986.208693:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791986.208714:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875683785806080:0@lo:38:kworker.0 00000100:00100000:3.0:1788791986.208743:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791986.208767:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875683785806208:0@lo:38:kworker.0 00000100:00100000:3.0:1788791986.208788:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791986.208801:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875683785806464:0@lo:38:kworker.0 00000100:00100000:3.0:1788791986.208820:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791986.208863:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785805824 00000100:00100000:3.0:1788791986.208869:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785805824 00000100:00100000:3.0:1788791986.208907:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788791986.208912:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875683785805824:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788791986.208931:0:17101:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788791986.208979:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875683785805824:12345-0@lo:38:kworker.0 Request processed in 65us (285us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788791986.208986:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788791986.209017:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785806080 00000100:00100000:3.0:1788791986.209021:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785806080 00000100:00100000:3.0:1788791986.209038:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785806208 00000100:00100000:3.0:1788791986.209041:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785806208 00000100:00100000:3.0:1788791986.209053:0:19434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785806464 00000100:00100000:3.0:1788791986.209056:0:19434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785806464 00000100:00100000:3.0:1788791986.209066:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788791986.209071:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604307f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875683785806080:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788791986.209080:0:19434:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788791986.209104:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604307f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875683785806080:12345-0@lo:38:kworker.0 Request processed in 32us (361us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788791986.209110:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788791986.209121:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788791986.209125:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604307d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875683785806208:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788791986.209134:0:19434:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788791986.209164:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604307d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875683785806208:12345-0@lo:38:kworker.0 Request processed in 37us (374us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788791986.209170:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788791986.209181:0:19434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788791986.209185:0:19434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604307df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875683785806464:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788791986.209193:0:19434:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788791986.209214:0:19434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604307df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875683785806464:12345-0@lo:38:kworker.0 Request processed in 27us (393us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788791986.209219:0:19434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788791986.209246:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6042332800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788791986.209250:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788791986.209253:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785805824:0@lo:38:kworker.0 00000100:00080000:3.0:1788791986.209262:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6175f25000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788791986.209264:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788791986.209267:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875683785806080:0@lo:38:kworker.0 00000100:00080000:3.0:1788791986.209273:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c604353c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788791986.209276:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788791986.209278:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875683785806208:0@lo:38:kworker.0 00000100:00080000:3.0:1788791986.209284:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c60420b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788791986.209287:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788791986.209289:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875683785806464:0@lo:38:kworker.0 00000100:00100000:2.0:1788791986.209913:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875683785806592:0@lo:400:kworker.0 00000100:00100000:2.0:1788791986.209950:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791986.209985:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788791986.209992:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875683785806336:0@lo:400:kworker.0 00000100:00100000:2.0:1788791986.210026:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791986.210065:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785805952:0@lo:400:kworker.0 00000100:00100000:2.0:1788791986.210092:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791986.210113:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788791986.210119:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3644:1875683785805696:0@lo:400:kworker.0 00000400:00000100:2.0:1788791986.210138:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875683785805696 offset 0 length 224: 4 00000100:00100000:2.0:1788791986.210167:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785806592 00000100:00100000:2.0:1788791986.210172:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785806592 00000100:00100000:2.0:1788791986.210205:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785806336 00000100:00100000:2.0:1788791986.210209:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785806336 00000100:00100000:2.0:1788791986.210226:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788791986.210233:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875683785806592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791986.210274:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875683785806592:12345-0@lo:400:kworker.0 Request processed in 42us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791986.210281:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788791986.210295:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788791986.210302:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875683785806336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791986.210327:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875683785806336:12345-0@lo:400:kworker.0 Request processed in 26us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791986.210333:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1788791986.210914:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788791986.234118:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8c6151f4f800 x1875683785806336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791986.234139:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875683785806336:0@lo:400:kworker.0 00010000:00080000:1.0:1788791986.234179:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8c6151f4fb80 x1875683785806592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791986.234188:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875683785806592:0@lo:400:kworker.0 00000100:00100000:2.0:1788791986.238697:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785805952 00000100:00100000:2.0:1788791986.238713:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785805952 00000100:00100000:2.0:1788791986.238805:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788791986.238818:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785805952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791986.238954:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785805952:12345-0@lo:400:kworker.0 Request processed in 139us (28859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791986.238962:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788791986.239237:0:17091:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791986.239305:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785805952:0@lo:400:kworker.0 00010000:00010000:2.0:1788791986.390389:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788791986.391119:0:20872:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788791986.413976:0:20872:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788791986.414037:0:20872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c61413aa200/0x4d37c11031f35af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f35afd expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.414051:0:20872:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c61413aa200/0x4d37c11031f35af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f35afd expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.414059:0:20872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c61413aa200/0x4d37c11031f35af6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35afd expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.414067:0:20872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c61413aa200/0x4d37c11031f35af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35afd expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.414091:0:20872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788791986.414097:0:20872:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788791986.414122:0:20872:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788791986.414126:0:20872:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788791986.414132:0:20872:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788791986.414137:0:20872:0:(import.c:65:import_set_state_nolock()) ffff8c6175f25000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788791986.414142:0:20872:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788791986.414144:0:20872:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788791986.414146:0:20872:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788791986.414433:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791986.414440:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c61413aa200/0x4d37c11031f35af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35afd expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791986.414474:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413aa200 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:3.0:1788791986.414479:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c61413aa200/0x4d37c11031f35af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35afd expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791986.414493:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c61413aa200/0x4d37c11031f35af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f35afd expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788791986.414501:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c61413aa200/0x4d37c11031f35af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f35afd expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791986.414507:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788791986.414509:0:17084:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788791986.414512:0:17084:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788791986.414546:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c61413aa200/0x4d37c11031f35af6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35afd expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791986.414553:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788791986.414591:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c61413aa200/0x4d37c11031f35af6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35afd expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791986.414599:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c61413aa200/0x4d37c11031f35af6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35afd expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791986.414612:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791986.414613:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791986.414615:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791986.414904:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788791986.414923:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3644:1875683785806720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791986.414972:0:20872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430afe00/0x4d37c11031f35a55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f35a5c expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.414990:0:20872:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430afe00/0x4d37c11031f35a55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f35a5c expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.414996:0:20872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430afe00/0x4d37c11031f35a55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35a5c expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415003:0:20872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c60430afe00/0x4d37c11031f35a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35a5c expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791986.415006:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788791986.415016:0:20872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788791986.415025:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791986.415030:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c60430afe00/0x4d37c11031f35a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35a5c expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415035:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c60430afe00 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:1.0:1788791986.415038:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c60430afe00/0x4d37c11031f35a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35a5c expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415045:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c60430afe00/0x4d37c11031f35a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f35a5c expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791986.415051:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c60430afe00/0x4d37c11031f35a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f35a5c expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791986.415057:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788791986.415059:0:17085:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1788791986.415072:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c60430afe00/0x4d37c11031f35a55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35a5c expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415088:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791986.415107:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c60430afe00/0x4d37c11031f35a55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35a5c expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415114:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c60430afe00/0x4d37c11031f35a55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35a5c expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415124:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791986.415126:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791986.415127:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791986.415138:0:20872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430af600/0x4d37c11031f35d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f35d50 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415145:0:20872:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430af600/0x4d37c11031f35d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f35d50 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415153:0:20872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430af600/0x4d37c11031f35d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35d50 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415159:0:20872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c60430af600/0x4d37c11031f35d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35d50 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415170:0:20872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788791986.415176:0:20872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f35eed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f35ef4 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415182:0:20872:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f35eed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f35ef4 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415197:0:20872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f35eed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35ef4 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415203:0:20872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f35eed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35ef4 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415214:0:20872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788791986.415221:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788791986.415224:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c60430af600/0x4d37c11031f35d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35d50 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415229:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c60430af600 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:1.0:1788791986.415232:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c60430af600/0x4d37c11031f35d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35d50 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415238:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c60430af600/0x4d37c11031f35d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f35d50 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791986.415243:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c60430af600/0x4d37c11031f35d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f35d50 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791986.415248:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788791986.415249:0:17084:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788791986.415251:0:17084:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788791986.415265:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c60430af600/0x4d37c11031f35d49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35d50 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415270:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791986.415283:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c60430af600/0x4d37c11031f35d49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35d50 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415296:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c60430af600/0x4d37c11031f35d49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35d50 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415306:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791986.415309:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f35eed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35ef4 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415314:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140030c00 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:1.0:1788791986.415318:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f35eed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35ef4 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415324:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f35eed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f35ef4 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791986.415331:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f35eed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f35ef4 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791986.415335:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788791986.415337:0:17084:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788791986.415339:0:17084:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788791986.415352:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f35eed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35ef4 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415358:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791986.415364:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f35eed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35ef4 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415370:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f35eed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35ef4 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.415389:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791986.415390:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791986.415392:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791986.415404:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3641:1875683785806976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791986.415433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791986.415456:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791986.415461:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3641:1875683785807104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791986.415481:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791986.415509:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785806720 00000100:00100000:1.0:1788791986.415515:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785806720 00000100:00100000:1.0:1788791986.415545:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785806976 00000100:00100000:1.0:1788791986.415548:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785806976 00000100:00100000:1.0:1788791986.415557:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785807104 00000100:00100000:1.0:1788791986.415559:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785807104 00000100:00100000:1.0:1788791986.415571:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788791986.415578:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1875683785806720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788791986.415583:0:17082:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788791986 with bad export cookie 5564128139941206305 00000100:00100000:0.0:1788791986.415626:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3644:1875683785806848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791986.415650:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791986.416355:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785806848 00000100:00100000:2.0:1788791986.416361:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785806848 00000100:00100000:3.0:1788791986.416379:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788791986.416385:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1875683785806976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788791986.416390:0:17083:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788791986 with bad export cookie 5564128139941206305 00010000:00010000:2.0:1788791986.416393:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791986.416441:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1875683785806976:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (1007us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788791986.416449:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788791986.416476:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788791986.416481:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1875683785807104:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788791986.416485:0:17083:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788791986 with bad export cookie 5564128139941206305 00000100:00080000:0.0:1788791986.416661:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788791986.416667:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8c617faf5800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788791986.416670:0:3641:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788791986.416719:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1875683785807104:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (1236us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788791986.416726:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788791986.416738:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788791986.416742:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1875683785806848:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788791986.416747:0:17083:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788791986 with bad export cookie 5564128139941206305 00000100:00100000:3.0:1788791986.416794:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1875683785806848:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (1143us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788791986.416800:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788791986.416822:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1788791986.434718:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1875683785806720:12345-0@lo:103:ldlm_bl.0 Request processed in 19135us (19707us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788791986.434731:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788791986.434780:0:20872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430afa00/0x4d37c11031f35a47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f35a4e expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.434793:0:20872:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430afa00/0x4d37c11031f35a47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f35a4e expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.434801:0:20872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430afa00/0x4d37c11031f35a47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35a4e expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.437969:0:20872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c60430afa00/0x4d37c11031f35a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35a4e expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.438056:0:20872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788791986.438065:0:20872:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1788791986.438072:0:20872:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:1.0:1788791986.438113:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791986.438119:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c60430afa00/0x4d37c11031f35a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35a4e expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.438128:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c60430afa00 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:1.0:1788791986.438131:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c60430afa00/0x4d37c11031f35a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35a4e expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.438142:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c60430afa00/0x4d37c11031f35a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f35a4e expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791986.438150:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c60430afa00/0x4d37c11031f35a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f35a4e expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791986.438157:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788791986.438159:0:17085:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788791986.438161:0:17085:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:0.0:1788791986.493857:0:3641:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.120@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788791986.493864:0:3641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788791986.493911:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c6043d15c00 x1875683785803776/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788791997 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791986.493928:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c6151f4ca80 x1875683785805696/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788792002 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791986.493938:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c6151f4dc00 x1875683785806720/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788792002 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791986.493980:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c6043d17b80 x1875683785806976/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788792002 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791986.494002:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c6043d16680 x1875683785807104/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788792002 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791986.494011:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c6043d14380 x1875683785806848/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788792002 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788791986.494021:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788791986.494024:0:3641:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788791986.494025:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788791986.503611:0:3644:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c617faf5800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788791986.503969:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3644:1875683785806720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788791986.503982:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3644:1875683785805696:0@lo:400:kworker.0 00000100:00100000:3.0:1788791986.504003:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3644:1875683785803776:0@lo:400:kworker.0 00000100:00100000:3.0:1788791986.504039:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3644:1875683785806848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791986.515529:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c60430afa00/0x4d37c11031f35a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35a4e expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.515545:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791986.515572:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c60430afa00/0x4d37c11031f35a47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35a4e expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.515598:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c60430afa00/0x4d37c11031f35a47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4d37c11031f35a4e expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791986.515620:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791986.515622:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791986.515624:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788791986.515644:0:20872:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788791986.515648:0:20872:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788791986.515654:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788791986.515660:0:20872:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788791986.515668:0:20872:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8c604377b000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788791986.515674:0:20872:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8c6175f22000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788791986.515678:0:20872:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8c60433e0000) has exports, disconnecting them 00000020:00080000:1.0:1788791986.515682:0:20872:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8c604377b000), last request at 1788791986 00000020:00000080:1.0:1788791986.515690:0:20872:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35d3b 00000100:00080000:1.0:1788791986.515707:0:20872:0:(import.c:65:import_set_state_nolock()) ffff8c604377f800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788791986.515731:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788791986.515749:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b5ad001-761f-497e-bfbf-b3c6140a93fd:0:1875683785807232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791986.515757:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788791986.515769:0:20872:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c604377b000): rc 0 00000020:00000080:1.0:1788791986.515771:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c604377b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788791986.515792:0:20872:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8c6175f22000), last request at 1788791986 00000020:00000080:1.0:1788791986.515795:0:20872:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35bd6 00000100:00080000:1.0:1788791986.515801:0:20872:0:(import.c:65:import_set_state_nolock()) ffff8c6175f23800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788791986.515820:0:20872:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c6175f22000): rc 0 00000020:00000080:1.0:1788791986.515822:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6175f22000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788791986.515837:0:20872:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9d26019cbae0 00000100:00080000:1.0:1788791986.515856:0:20872:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788791986.515865:0:20872:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8c6174cec000 x1875683785803392/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788791995 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791986.515904:0:20872:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788791986.515968:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788791986.516664:0:20872:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788791986.516669:0:20872:0:(import.c:65:import_set_state_nolock()) ffff8c6042332800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:3.0:1788791986.517025:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c604377b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788791986.517079:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6175f22000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788791986.517102:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c604377f800 for lustre-MDT0001 00000020:00000080:3.0:1788791986.517116:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6175f23800 for lustre-MDT0001 00000100:00080000:1.0:1788791986.519338:0:20872:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788791986.519345:0:20872:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788791986.519395:0:20872:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788791986.519455:0:20872:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788791986.519483:0:20872:0:(import.c:65:import_set_state_nolock()) ffff8c617b745800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788791986.519503:0:20872:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788791986.519506:0:20872:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788791986.519517:0:20872:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788791986.519581:0:20872:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788791986.519591:0:20872:0:(import.c:65:import_set_state_nolock()) ffff8c6043730800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788791986.519629:0:20872:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8c60433e0000) has no exports 00000100:00100000:3.0:1788791986.519818:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785807360:0@lo:9:umount.0 00000100:00100000:3.0:1788791986.519920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791986.519959:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785807488:0@lo:9:umount.0 00000100:00100000:3.0:1788791986.519984:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791986.520042:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785807360 00000100:00100000:3.0:1788791986.520050:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785807360 00000100:00100000:3.0:1788791986.520089:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785807488 00000100:00100000:3.0:1788791986.520092:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785807488 00000100:00100000:3.0:1788791986.520119:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788791986.520129:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875683785807360:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788791986.520153:0:18605:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35c00 00000100:00080000:3.0:1788791986.520162:0:18605:0:(import.c:65:import_set_state_nolock()) ffff8c617bd63800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788791986.520197:0:18605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788791986.520331:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3640:x1875683785807360:12345-0@lo:9:umount.0 Request processed in 202us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791986.520339:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788791986.520355:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788791986.520361:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875683785807488:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788791986.520372:0:18605:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35d6c 00000100:00080000:3.0:1788791986.520378:0:18605:0:(import.c:65:import_set_state_nolock()) ffff8c61812b5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788791986.520401:0:18605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788791986.520471:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3640:x1875683785807488:12345-0@lo:9:umount.0 Request processed in 110us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791986.520478:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:3.0:1788791986.520497:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788791986.520521:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c617b745800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788791986.520604:0:3641:0:(import.c:65:import_set_state_nolock()) ffff8c617faf5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788791986.520610:0:3641:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 523 00000100:00080000:0.0:1788791986.520616:0:3641:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8c617faf5800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788791986.520636:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043dc8000 x1875683785807616/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788791986.520652:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6174cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785803392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788791986.520675:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3641:1875683785807104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791986.520680:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3641:1875683785806976:0@lo:103:ldlm_bl.0 00000004:00080000:3.0:1788791986.526033:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00010000:00010000:2.0:1788791986.535966:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788791986.536409:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788791986.536423:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785807360:0@lo:9:umount.0 00000100:00080000:3.0:1788791986.536467:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6043730800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788791986.536480:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788791986.536482:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788791986.536485:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785807488:0@lo:9:umount.0 00000100:00100000:3.0:1788791986.536517:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3640:1875683785807616:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788791986.536566:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875683785807616 offset 0 length 520: 4 00000020:00080000:2.0:1788791986.548252:0:20872:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8c60433e0000) has no exports 00000020:01000000:3.0:1788791986.611569:0:20872:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c617666bea0 - data ffff8c615d81faf8/ffff8c6181294000 00000020:01000000:3.0:1788791986.611810:0:20872:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c61582ba2a0 - data ffff8c616078d0d8/ffff8c617675f800 00000001:00000004:1.0:1788791986.624354:0:20872:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1788791986.694775:0:20872:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788791986.694921:0:20872:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788791986.694930:0:20872:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788791986.697064:0:20872:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788791986.697069:0:20872:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788791986.697089:0:20872:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788791986.697091:0:20872:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788791986.699229:0:17838:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788791986.699243:0:17838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788791986.699269:0:17838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788791986.699812:0:20872:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788791986.699817:0:20872:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788791986.699844:0:20872:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788791986.699846:0:20872:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788791986.702232:0:17840:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788791986.702238:0:17840:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788791986.702250:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788791986.712556:0:20872:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35a6a 00000020:00000080:0.0:1788791986.712576:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6043686000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788791986.713359:0:20872:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35a7f 00000020:00000080:0.0:1788791986.713366:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6175ee5800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788791986.713373:0:20872:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788791986.713377:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791986.713384:0:20872:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788791986.713388:0:20872:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8c60433e3370) has no exports 00000004:01000000:0.0:1788791986.713543:0:20872:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788791986.713551:0:20872:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35ad3 00000020:00000080:0.0:1788791986.713555:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6043731000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788791986.713559:0:20872:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788791986.713562:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791986.713567:0:20872:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788791986.713570:0:20872:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8c6175c40000) has no exports 00000020:00000080:0.0:1788791986.713574:0:20872:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35acc 00000020:00000080:0.0:1788791986.713577:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6043737000/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788791986.713912:0:20872:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788791986.713916:0:20872:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788791986.713921:0:20872:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788791986.713926:0:20872:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788791986.713928:0:20872:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788791986.713955:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791986.713961:0:20872:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788791986.713965:0:20872:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35abe 00000020:00000080:0.0:1788791986.713969:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6043732000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788791986.713972:0:20872:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788791986.713975:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791986.713977:0:20872:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788791986.713979:0:20872:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8c6150e20000) has no exports 00000020:00000080:0.0:1788791986.713983:0:20872:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35ab0 00000020:00000080:3.0:1788791986.714339:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043686000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788791986.714359:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6175ee5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788791986.714365:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043731000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788791986.714369:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043737000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788791986.714373:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6043730800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788791986.714378:0:8:0:(genops.c:885:class_export_put()) final put ffff8c6043733800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788791986.714380:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043733800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788791986.714383:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788791986.714466:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043732000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788791986.718025:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c617b742800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788791986.718671:0:20872:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788791986.718677:0:20872:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788791986.718680:0:20872:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788791986.718686:0:20872:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788791986.718688:0:20872:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788791986.718716:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788791986.718723:0:20872:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788791986.718743:0:20872:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788791986.718749:0:20872:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35aa2 00000020:00000080:1.0:1788791986.718754:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6043684800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788791986.718759:0:20872:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788791986.718772:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788791986.718778:0:20872:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788791986.718782:0:20872:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8c6174c999b8) has no exports 00000020:00000080:1.0:1788791986.718788:0:20872:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35a9b 00000020:00000080:1.0:1788791986.718792:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6042332000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788791986.719161:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617b742800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788791986.719176:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c617b745800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788791986.719189:0:8:0:(genops.c:885:class_export_put()) final put ffff8c6043686800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788791986.719192:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043686800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788791986.719198:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788791986.719272:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043684800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788791986.719280:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6042332000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788791986.722555:0:20872:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788791986.722572:0:20872:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788791986.722576:0:20872:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788791986.722583:0:20872:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788791986.722628:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791986.722638:0:20872:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788791986.722663:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791986.722666:0:20872:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788791986.722671:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6175e42000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788791986.722675:0:20872:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6175e42000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788791986.722682:0:20872:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788791986.722821:0:20872:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35a86 00000020:00000080:0.0:1788791986.722839:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6043687800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788791986.722844:0:20872:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788791986.722849:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791986.722853:0:20872:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788791986.722856:0:20872:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8c60433e4d28) has no exports 00000020:00000080:0.0:1788791986.722892:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791986.722895:0:20872:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788791986.722899:0:20872:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35a8d 00000020:00000080:0.0:1788791986.722902:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6043683000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788791986.722910:0:20872:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c6175ee3800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788791986.722913:0:20872:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c6175ee3800 2 00000020:01000004:0.0:1788791986.722916:0:20872:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c6175ee3800 from lustre-MDT0001 00000020:00000080:0.0:1788791986.722934:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791986.722937:0:20872:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788791986.722940:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6043684000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788791986.722943:0:20872:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043684000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788791986.722948:0:20872:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788791986.722974:0:20872:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788791986.722977:0:20872:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788791986.722979:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791986.722982:0:20872:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788791986.723199:0:20872:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8c61475a4800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788791986.723205:0:20872:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8c6174c98000) has exports, disconnecting them 00000020:00080000:0.0:1788791986.723210:0:20872:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8c61475a4800), last request at 1788791897 00000020:00000080:0.0:1788791986.723214:0:20872:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35b0b 00000020:00080000:0.0:1788791986.723227:0:20872:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c61475a4800): rc 0 00000020:00000080:0.0:1788791986.723232:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c61475a4800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788791986.723599:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6042332800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788791986.723606:0:8:0:(genops.c:885:class_export_put()) final put ffff8c617b747800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788791986.723608:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617b747800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788791986.723612:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788791986.723690:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043687800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788791986.723694:0:8:0:(genops.c:885:class_export_put()) final put ffff8c6043682000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788791986.723696:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043682000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788791986.723699:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788791986.723781:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6043683000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788791986.723785:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c61475a4800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788791986.768366:0:20872:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788791986.768377:0:20872:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788791986.768382:0:20872:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788791986.768390:0:20872:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788791986.768483:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c6175f25000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788791986.768645:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791986.768655:0:20872:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788791986.768660:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6175f27000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788791986.768664:0:20872:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6175f27000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788791986.768670:0:20872:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788791986.768749:0:20872:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c6175ee3800 1 00000020:00000080:0.0:1788791986.768756:0:20872:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35a32 00000020:00000080:0.0:1788791986.768762:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6175e40800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788791986.768778:0:20872:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788791986.768783:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791986.768788:0:20872:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788791986.768792:0:20872:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8c60433e19b8) has no exports 00000020:00000080:3.0:1788791986.768798:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6175e40800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788791986.840258:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791986.840272:0:20872:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788791986.840278:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c6175ee1800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788791986.840282:0:20872:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6175ee1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788791986.840293:0:20872:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788791986.840399:0:20872:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c6175ee7000 00000020:01000000:3.0:1788791986.840418:0:20872:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788791986.840422:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791986.840427:0:20872:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788791986.840431:0:20872:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8c60424acd28) has no exports 00000100:00100000:3.0:1788791986.840527:0:19939:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8c60423e4e00:19939] 4 exiting: rc = 0 00000100:00100000:3.0:1788791986.840636:0:17096:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8c61503f2400:17096] 0 exiting: rc = 1 00000100:00100000:1.0:1788791986.840766:0:17097:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8c61503f2600:17097] 1 exiting: rc = 0 00000100:00100000:2.0:1788791986.840903:0:17098:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8c61503f3a00:17098] 2 exiting: rc = 0 00000100:00100000:0.0:1788791986.841033:0:19434:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8c60426b2a00:19434] 3 exiting: rc = 0 00000100:00100000:2.0:1788791986.841180:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841187:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841193:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841198:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841204:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841209:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841215:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841221:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841227:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841232:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841237:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841243:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841248:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841254:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841264:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841270:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841276:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841282:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841287:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841292:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841298:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841303:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841309:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841320:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841326:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841332:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841337:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841342:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841348:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841353:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841359:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841364:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841369:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841374:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841379:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841386:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841392:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841397:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841402:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841408:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841415:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841424:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841431:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841437:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841445:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841454:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841460:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841467:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841474:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841479:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841485:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841490:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841496:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841501:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841507:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841512:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841518:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841523:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841533:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841539:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841544:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841550:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841555:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.841561:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791986.845038:0:17100:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8c604235b800:17100] 1 exiting: rc = 0 00000100:00100000:2.0:1788791986.845982:0:17099:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8c60430c8600:17099] 0 exiting: rc = 1 00000100:00100000:2.0:1788791986.846036:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846044:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846051:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846063:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846069:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846077:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846085:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846090:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846096:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846101:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846106:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846112:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846117:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846123:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846128:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846133:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846138:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846144:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846149:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846154:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846159:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846164:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846169:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846175:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846180:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846185:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846191:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846196:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846211:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846216:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846221:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846227:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846232:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846237:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846242:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846248:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846253:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846258:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846263:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846269:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846274:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846279:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846284:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846289:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846294:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846299:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846304:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846309:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846313:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846319:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846324:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846329:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846334:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846339:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846344:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846349:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846355:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846360:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846365:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846370:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846375:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846381:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846386:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846396:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.846919:0:17102:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8c604235ac00:17102] 1 exiting: rc = 0 00000100:00100000:0.0:1788791986.847058:0:17101:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8c604235ae00:17101] 0 exiting: rc = 1 00000100:00100000:0.0:1788791986.847201:0:17811:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8c61503f2a00:17811] 2 exiting: rc = 0 00000100:00100000:2.0:1788791986.847283:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847289:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847300:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847308:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847314:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847328:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847335:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847341:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847347:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847353:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847359:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847365:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847371:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847377:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847383:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847388:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847398:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847421:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847428:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847433:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847439:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847445:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847451:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847459:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847466:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847473:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847481:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847487:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847494:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847513:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847521:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847527:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847533:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847546:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847551:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847559:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847564:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847570:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847576:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847586:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847595:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847617:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847623:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847630:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847635:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847641:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847647:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847653:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847662:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847668:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847674:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847680:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847686:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847704:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847710:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847779:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847788:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847794:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847800:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847806:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847812:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847818:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847830:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.847837:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853525:0:17104:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8c604235b000:17104] 1 exiting: rc = 0 00000100:00100000:0.0:1788791986.853668:0:17103:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8c604235a600:17103] 0 exiting: rc = 1 00000100:00100000:2.0:1788791986.853812:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853818:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853834:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853853:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853859:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853865:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853870:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853924:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853929:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853935:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853940:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853945:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853950:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853955:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853960:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853965:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853970:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853976:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853982:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853988:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853993:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.853997:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854003:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854008:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854013:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854018:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854023:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854028:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854033:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854038:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854043:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854048:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854054:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854059:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854065:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854070:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854075:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854080:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854091:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854096:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854101:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854107:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854111:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854117:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854122:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854128:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854133:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854138:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854143:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854149:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854154:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854158:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854163:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854168:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854173:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854178:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854183:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854188:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854193:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854198:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854203:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854207:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854212:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.854217:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791986.854529:0:17106:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8c604235be00:17106] 1 exiting: rc = 0 00000100:00100000:1.0:1788791986.855069:0:17105:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8c604235bc00:17105] 0 exiting: rc = 1 00000100:00100000:2.0:1788791986.855803:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855809:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855814:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855820:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855836:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855843:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855848:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855854:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855859:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855888:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855894:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855899:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855905:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855909:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855915:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855920:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855926:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855931:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855936:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855941:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855948:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855954:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855960:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855965:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855972:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855978:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855984:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855992:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.855998:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856003:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856017:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856022:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856028:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856035:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856042:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856049:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856056:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856066:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856072:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856078:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856084:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856088:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856093:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856098:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856108:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856113:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856119:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856124:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856129:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856134:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856139:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856144:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856149:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856154:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856159:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856164:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856169:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856174:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856179:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856184:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856189:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856194:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856199:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856204:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791986.856706:0:17108:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8c61815f8400:17108] 1 exiting: rc = 0 00000100:00100000:2.0:1788791986.856939:0:17107:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8c61815f9e00:17107] 0 exiting: rc = 1 00000100:00100000:2.0:1788791986.856981:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856987:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856992:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.856998:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857002:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857008:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857012:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857018:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857024:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857029:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857034:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857039:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857044:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857049:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857062:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857068:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857074:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857079:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857085:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857091:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857096:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857102:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857106:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857111:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857116:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857121:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857126:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857130:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857135:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857139:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857144:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857148:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857153:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857158:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857163:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857168:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857174:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857179:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857184:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857189:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857195:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857200:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857205:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857210:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857215:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857219:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857225:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857230:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857235:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857245:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857250:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857255:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857260:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857265:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857271:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857276:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857281:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857287:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857292:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857297:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857302:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857308:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857313:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791986.857318:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791986.857864:0:17109:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8c6154415400:17109] 0 exiting: rc = 1 00000100:00100000:0.0:1788791986.858267:0:17111:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8c61453dc600:17111] 2 exiting: rc = 0 00000100:00100000:2.0:1788791986.858560:0:17110:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8c61453dda00:17110] 1 exiting: rc = 0 00000100:00100000:3.0:1788791986.858639:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858647:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858653:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858658:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858664:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858670:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858675:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858681:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858687:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858699:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858706:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858711:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858716:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858722:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858727:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858733:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858738:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858745:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858751:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858757:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858763:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858768:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858773:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858778:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858785:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858791:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858796:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858801:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858807:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858812:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858817:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858834:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858841:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858859:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858895:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858902:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858908:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858914:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858920:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858925:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858931:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858938:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858944:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858949:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858955:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858961:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858967:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858972:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858978:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858984:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858989:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.858995:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.859001:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.859007:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.859012:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.859018:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.859023:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.859041:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.859048:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.859054:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.859060:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.859066:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.859072:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791986.859078:0:20872:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788791986.862322:0:20872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791986.862334:0:20872:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788791986.862340:0:20872:0:(genops.c:885:class_export_put()) final put ffff8c617faf3000/MDS_uuid 00000020:00000080:3.0:1788791986.862344:0:20872:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617faf3000/MDS_uuid for MDS 00000020:01000000:3.0:1788791986.862349:0:20872:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788791986.862480:0:20872:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788791987.414075:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791988.439085:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791989.463187:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791990.487161:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788791991.318066:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1b5ad001-761f-497e-bfbf-b3c6140a93fd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788791991.318078:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1b5ad001-761f-497e-bfbf-b3c6140a93fd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788791991.318081:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788791991.318085:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788791991.318090:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c604353c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788791991.318099:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 629 00000100:00080000:3.0:1788791991.318105:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788791991.318111:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c604353c000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788791991.318152:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6151f4fb80 x1875683785807744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788791991.318233:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875683785807744:0@lo:38:kworker.0 00000400:00000100:2.0:1788791991.318291:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683785807744 offset 0 length 520: 4 00000100:00080000:3.0:1788791991.318618:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788791991.318623:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788791991.318625:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c60420b7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788791991.318629:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 629 00000100:00080000:3.0:1788791991.318632:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788791991.318636:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c60420b7000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788791991.318649:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6151f4c000 x1875683785808000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788791991.318691:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875683785807872:0@lo:400:kworker.0 00000400:00000100:1.0:1788791991.318717:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683785807872 offset 0 length 224: 4 00000100:00100000:0.0:1788791991.324257:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875683785808000:0@lo:38:kworker.0 00000400:00000100:0.0:1788791991.324322:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683785808000 offset 0 length 520: 4 00000100:00100000:0.0:1788791991.327402:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875683785808128:0@lo:400:kworker.0 00000400:00000100:0.0:1788791991.327458:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683785808128 offset 0 length 224: 4 00000020:01000004:2.0:1788791991.409233:0:21072:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788791991.441420:0:21072:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788791991.441490:0:21072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f35ba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f35bac expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791991.441508:0:21072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f35ba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f35bac expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791991.441516:0:21072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f35ba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35bac expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791991.441523:0:21072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f35ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35bac expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791991.441607:0:21072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788791991.441614:0:21072:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788791991.441642:0:21072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788791991.441657:0:21072:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c6151f4fb80 x1875683785807744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788792011 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791991.441677:0:21072:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788791991.441683:0:21072:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788791991.441689:0:21072:0:(import.c:65:import_set_state_nolock()) ffff8c604353c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788791991.441694:0:21072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788791991.441697:0:21072:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c6151f4fb80 x1875683785807744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788792011 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791991.441704:0:21072:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788791991.441707:0:21072:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000100:00100000:0.0:1788791991.441854:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875683785807744:0@lo:38:kworker.0 00000100:00080000:2.0:1788791991.442995:0:21072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788791991.443007:0:21072:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c6151f4f800 x1875683785807872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792007 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791991.443037:0:21072:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788791991.443043:0:21072:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788791991.443066:0:21072:0:(import.c:65:import_set_state_nolock()) ffff8c604353d000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788791991.443156:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875683785808256:0@lo:39:umount.0 00000400:00000100:0.0:1788791991.443217:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683785808256 offset 0 length 224: 4 00010000:00010000:1.0:1788791991.443343:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791991.443352:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f35ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35bac expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791991.443361:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b953800 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:1.0:1788791991.443365:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f35ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35bac expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791991.443375:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f35ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f35bac expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791991.443383:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f35ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f35bac expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791991.443389:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788791991.443391:0:17084:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788791991.443394:0:17084:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788791991.443420:0:17084:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c617faf5800 00010000:00010000:1.0:1788791991.443424:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f35ba5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4d37c11031f35bac expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791991.443430:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f35ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4d37c11031f35bac expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791991.443443:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791991.443444:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791991.443446:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791991.443516:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875683785807872:0@lo:400:kworker.0 00010000:00010000:2.0:1788791991.510155:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788791991.843783:0:18600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788791991.843796:0:18600:0:(genops.c:885:class_export_put()) final put ffff8c617bd65800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788791991.843937:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617bd65800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788791991.844014:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c617bd63800 for lustre-OST0000 00000001:00100000:2.0:1788791991.853560:0:19419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788791991.853583:0:19419:0:(genops.c:885:class_export_put()) final put ffff8c61812b2000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788791991.853778:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c61812b2000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788791991.853833:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c61812b5000 for lustre-OST0001 00010000:00010000:1.0:1788791992.534499:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791993.565690:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791994.586186:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791995.606094:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788791996.438581:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1b5ad001-761f-497e-bfbf-b3c6140a93fd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788791996.438652:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1b5ad001-761f-497e-bfbf-b3c6140a93fd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788791996.438733:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788791996.438736:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788791996.438848:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875683785808384:0@lo:400:kworker.0 00000400:00000100:2.0:1788791996.438939:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683785808384 offset 0 length 224: 4 00000100:00100000:0.0:1788791996.565995:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791986/real 1788791986] req@ffff8c6043dc8000 x1875683785807616/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788791996 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791996.566030:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c6043dc8000 x1875683785807616/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788791996 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788791996.566052:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c617faf5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788791996.566202:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788791996.566208:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3640:1875683785807616:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1788791996.566477:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1b5ad001-761f-497e-bfbf-b3c6140a93fd->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788791996.566483:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788791996.566487:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c617faf5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788791996.566492:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 629 00000100:00080000:1.0:1788791996.566498:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788791996.566503:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8c617faf5800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788791996.566537:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d15180 x1875683785808512/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788791996.566625:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3640:1875683785808512:0@lo:250:kworker.0 00000400:00000100:0.0:1788791996.566694:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875683785808512 offset 0 length 520: 4 00000100:00080000:1.0:1788791996.566761:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788791996.566765:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788791996.646782:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791997.657057:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791998.678865:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791999.702178:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792000.726696:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788792001.686050:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791991/real 1788791991] req@ffff8c6043709500 x1875683785808256/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788792001 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792001.686097:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c6043709500 x1875683785808256/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788792001 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788792001.686127:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c604353d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788792001.686176:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875683785808256:0@lo:39:umount.0 00000100:00080000:2.0:1788792001.688786:0:21072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788792001.688797:0:21072:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788792001.688805:0:21072:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788792001.689931:0:21072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6175ee9a00/0x4d37c11031f35b7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f35b82 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792001.689966:0:21072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6175ee9a00/0x4d37c11031f35b7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f35b82 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792001.689973:0:21072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6175ee9a00/0x4d37c11031f35b7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35b82 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792001.689980:0:21072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c6175ee9a00/0x4d37c11031f35b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35b82 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792001.690003:0:21072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788792001.690010:0:21072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f35edf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f35ee6 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792001.690016:0:21072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f35edf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f35ee6 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792001.690021:0:21072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f35edf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35ee6 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792001.690027:0:21072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f35edf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35ee6 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792001.690049:0:21072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788792001.690054:0:21072:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788792001.690087:0:21072:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788792001.690092:0:21072:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788792001.690096:0:21072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788792001.690102:0:21072:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788792001.690106:0:21072:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8c6043f64d28) has no exports 00000020:00080000:3.0:1788792001.690139:0:21072:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8c6043f64d28) has no exports 00010000:00010000:1.0:1788792001.690979:0:18630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788792001.690990:0:18630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c6175ee9a00/0x4d37c11031f35b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35b82 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792001.690998:0:18630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6175ee9a00 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:1.0:1788792001.691002:0:18630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c6175ee9a00/0x4d37c11031f35b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35b82 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792001.691011:0:18630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c6175ee9a00/0x4d37c11031f35b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f35b82 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788792001.691016:0:18630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c6175ee9a00/0x4d37c11031f35b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f35b82 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788792001.691021:0:18630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788792001.691023:0:18630:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788792001.691025:0:18630:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788792001.691040:0:18630:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c617faf5800 00010000:00010000:1.0:1788792001.691044:0:18630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c6175ee9a00/0x4d37c11031f35b7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4d37c11031f35b82 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792001.691049:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c6175ee9a00/0x4d37c11031f35b7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4d37c11031f35b82 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792001.691075:0:18630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792001.691078:0:18630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f35edf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35ee6 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792001.691084:0:18630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b953200 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:1.0:1788792001.691087:0:18630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f35edf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35ee6 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792001.691093:0:18630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f35edf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f35ee6 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788792001.691099:0:18630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f35edf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f35ee6 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788792001.691103:0:18630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788792001.691105:0:18630:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788792001.691107:0:18630:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788792001.691112:0:18630:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c617faf5800 00010000:00010000:1.0:1788792001.691115:0:18630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f35edf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4d37c11031f35ee6 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792001.691120:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f35edf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4d37c11031f35ee6 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792001.691127:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792001.691129:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792001.691130:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792001.692492:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788792001.694027:0:21072:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c6175e1e420 - data ffff8c6041cb1bd0/ffff8c6042119000 00000020:01000000:3.0:1788792001.694153:0:21072:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c60444343c0 - data ffff8c615d988798/ffff8c6148784400 00100000:10000000:3.0:1788792001.705914:0:21072:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788792001.722977:0:21072:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35b90 00000020:00000080:1.0:1788792001.723001:0:21072:0:(genops.c:885:class_export_put()) final put ffff8c6042090800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788792001.723024:0:21072:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c617bd4c800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788792001.723028:0:21072:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c617bd4c800 2 00000020:01000004:1.0:1788792001.723031:0:21072:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c617bd4c800 from lustre-OST0000 00000020:00000080:1.0:1788792001.723054:0:21072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788792001.723065:0:21072:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788792001.723068:0:21072:0:(genops.c:885:class_export_put()) final put ffff8c6042093000/lustre-OST0000_UUID 00000020:00000080:1.0:1788792001.723071:0:21072:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6042093000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788792001.723078:0:21072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788792001.723159:0:21072:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788792001.723163:0:21072:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788792001.723167:0:21072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788792001.723172:0:21072:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788792001.723179:0:21072:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8c604353d800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788792001.723185:0:21072:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff8c61714db370) has exports, disconnecting them 00000020:00080000:1.0:1788792001.723190:0:21072:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8c604353d800), last request at 1788791914 00000020:00000080:1.0:1788792001.723194:0:21072:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35bba 00000020:00080000:1.0:1788792001.723205:0:21072:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c604353d800): rc 0 00000020:00000080:1.0:1788792001.723210:0:21072:0:(genops.c:885:class_export_put()) final put ffff8c604353d800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788792001.727446:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6042090800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788792001.727472:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c604353d800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788792001.727502:0:21072:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788792001.727507:0:21072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788792001.727511:0:21072:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788792001.727517:0:21072:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788792001.727539:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c604353c000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788792001.727755:0:21072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788792001.727765:0:21072:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788792001.727771:0:21072:0:(genops.c:885:class_export_put()) final put ffff8c617bfbb800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788792001.727775:0:21072:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617bfbb800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788792001.727782:0:21072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788792001.727852:0:21072:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788792001.727856:0:21072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788792001.727860:0:21072:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788792001.727867:0:21072:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8c604353b800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788792001.727891:0:21072:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8c61714d99b8) has exports, disconnecting them 00000020:00080000:0.0:1788792001.727895:0:21072:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8c604353b800), last request at 1788791914 00000020:00000080:0.0:1788792001.727899:0:21072:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35bcf 00000020:00080000:0.0:1788792001.727911:0:21072:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c604353b800): rc 0 00000020:00000080:0.0:1788792001.727917:0:21072:0:(genops.c:885:class_export_put()) final put ffff8c604353b800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788792001.727944:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c604353b800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788792001.748363:0:21072:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788792001.748388:0:21072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788792001.748394:0:21072:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788792001.748403:0:21072:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788792001.748439:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c604353d000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788792001.748803:0:21072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788792001.748814:0:21072:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788792001.748820:0:21072:0:(genops.c:885:class_export_put()) final put ffff8c604353a800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788792001.748824:0:21072:0:(genops.c:844:class_export_destroy()) destroying export ffff8c604353a800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788792001.748836:0:21072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788792001.748928:0:21072:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c617bd4c800 1 00000020:00000080:2.0:1788792001.748934:0:21072:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35b6d 00000020:00000080:2.0:1788792001.748941:0:21072:0:(genops.c:885:class_export_put()) final put ffff8c61601cf800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788792001.748954:0:21072:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788792001.748964:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c61601cf800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788792001.748974:0:21072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788792001.748980:0:21072:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788792001.749021:0:21072:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff8c6174c9b370) has no exports 00000020:00000080:2.0:1788792001.785444:0:21072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788792001.785461:0:21072:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788792001.785467:0:21072:0:(genops.c:885:class_export_put()) final put ffff8c617bd4b800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788792001.785484:0:21072:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617bd4b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788792001.785496:0:21072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788792001.785825:0:21072:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c617bd4f000 00000020:02000400:2.0:1788792001.785924:0:21072:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788792001.999125:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788792002.076124:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1b5ad001-761f-497e-bfbf-b3c6140a93fd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788792002.076132:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1b5ad001-761f-497e-bfbf-b3c6140a93fd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788792002.076135:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788792002.076138:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788792002.076212:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788792002.076232:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875683785808640:0@lo:400:kworker.0 00000400:00000100:1.0:1788792002.076292:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683785808640 offset 0 length 224: 4 00010000:00010000:3.0:1788792003.037595:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792004.054115:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792005.078081:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792006.102184:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788792006.349514:0:21275:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788792006.370205:0:21275:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788792006.370291:0:21275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430aee00/0x4d37c11031f35d0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f35d11 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792006.370304:0:21275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430aee00/0x4d37c11031f35d0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f35d11 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792006.370311:0:21275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c60430aee00/0x4d37c11031f35d0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35d11 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792006.370318:0:21275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c60430aee00/0x4d37c11031f35d0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35d11 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792006.370374:0:21275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788792006.370380:0:21275:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788792006.370404:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788792006.370417:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c6151f4c000 x1875683785808000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788792011 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792006.370442:0:21275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788792006.370448:0:21275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788792006.370454:0:21275:0:(import.c:65:import_set_state_nolock()) ffff8c60420b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788792006.370460:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788792006.370464:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c6151f4c000 x1875683785808000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788792011 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792006.370471:0:21275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788792006.370474:0:21275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:3.0:1788792006.372730:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875683785808000:0@lo:38:kworker.0 00000100:00080000:1.0:1788792006.373960:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788792006.373976:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c6151f4f480 x1875683785808128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792007 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792006.373998:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c6043d14e00 x1875683785808384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792012 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792006.374035:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c6043d16a00 x1875683785808640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792018 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792006.374047:0:21275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788792006.374053:0:21275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788792006.374088:0:21275:0:(import.c:65:import_set_state_nolock()) ffff8c604377b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788792006.374124:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875683785808768:0@lo:39:umount.0 00000400:00000100:1.0:1788792006.374185:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683785808768 offset 0 length 224: 4 00000100:00100000:3.0:1788792006.375668:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875683785808384:0@lo:400:kworker.0 00000100:00100000:3.0:1788792006.376943:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875683785808640:0@lo:400:kworker.0 00000100:00100000:0.0:1788792006.377317:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875683785808128:0@lo:400:kworker.0 00010000:00010000:2.0:1788792006.377826:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788792006.377837:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c60430aee00/0x4d37c11031f35d0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35d11 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792006.377848:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c60430aee00 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:2.0:1788792006.377852:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c60430aee00/0x4d37c11031f35d0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35d11 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792006.377863:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c60430aee00/0x4d37c11031f35d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f35d11 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788792006.377885:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c60430aee00/0x4d37c11031f35d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f35d11 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788792006.377892:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788792006.377896:0:17084:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788792006.377899:0:17084:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788792006.377916:0:17084:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c617faf5800 00010000:00010000:2.0:1788792006.377920:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c60430aee00/0x4d37c11031f35d0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4d37c11031f35d11 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792006.377927:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c60430aee00/0x4d37c11031f35d0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4d37c11031f35d11 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792006.378825:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792006.378828:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792006.378830:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792007.126363:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788792007.192344:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1b5ad001-761f-497e-bfbf-b3c6140a93fd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788792007.192353:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1b5ad001-761f-497e-bfbf-b3c6140a93fd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788792008.150123:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792009.174500:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792010.198623:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792011.224216:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788792011.478262:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791996/real 1788791996] req@ffff8c6043d15180 x1875683785808512/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788792011 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792011.478303:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c6043d15180 x1875683785808512/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788792011 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788792011.478322:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c617faf5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788792011.478361:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788792011.478366:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3640:1875683785808512:0@lo:250:kworker.0 00000100:00080000:2.0:1788792011.478735:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1b5ad001-761f-497e-bfbf-b3c6140a93fd->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788792011.478743:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788792011.478746:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c617faf5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788792011.478753:0:38:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 639 00000100:00080000:2.0:1788792011.478759:0:38:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788792011.478767:0:38:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8c617faf5800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788792011.478811:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c604370aa00 x1875683785808896/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788792011.479601:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3640:1875683785808896:0@lo:250:kworker.0 00000400:00000100:1.0:1788792011.479658:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875683785808896 offset 0 length 520: 4 00010000:00010000:2.0:1788792012.250041:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792013.270317:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792014.294210:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792015.318788:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792016.342401:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788792016.598106:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788792006/real 1788792006] req@ffff8c6043d17480 x1875683785808768/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788792016 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792016.598180:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c6043d17480 x1875683785808768/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788792016 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788792016.598205:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c604377b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788792016.598232:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875683785808768:0@lo:39:umount.0 00000100:00080000:3.0:1788792016.601234:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788792016.601247:0:21275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788792016.601256:0:21275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788792016.602268:0:21275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f35ce0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f35ce7 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792016.602290:0:21275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f35ce0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f35ce7 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792016.602298:0:21275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f35ce0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35ce7 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792016.602317:0:21275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f35ce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35ce7 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792016.602341:0:21275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788792016.602350:0:21275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689000/0x4d37c11031f35ed1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f35ed8 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792016.602378:0:21275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689000/0x4d37c11031f35ed1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f35ed8 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792016.602384:0:21275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689000/0x4d37c11031f35ed1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35ed8 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792016.602390:0:21275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8c6141689000/0x4d37c11031f35ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4d37c11031f35ed8 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792016.602411:0:21275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788792016.602418:0:21275:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788792016.602456:0:21275:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788792016.602462:0:21275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788792016.602467:0:21275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788792016.602474:0:21275:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788792016.602480:0:21275:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8c6150e23370) has no exports 00000020:00080000:3.0:1788792016.602511:0:21275:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8c6150e23370) has no exports 00010000:00010000:2.0:1788792016.602702:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788792016.602723:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f35ce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35ce7 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792016.602736:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b953c00 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:2.0:1788792016.602741:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f35ce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35ce7 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792016.602753:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f35ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f35ce7 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788792016.602762:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f35ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f35ce7 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788792016.602795:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788792016.602867:0:17084:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788792016.602950:0:18630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792016.602959:0:18630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c6141689000/0x4d37c11031f35ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35ed8 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792016.602967:0:18630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689000 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:1.0:1788792016.602970:0:18630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c6141689000/0x4d37c11031f35ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4d37c11031f35ed8 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792016.602978:0:18630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c6141689000/0x4d37c11031f35ed1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f35ed8 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788792016.602984:0:18630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c6141689000/0x4d37c11031f35ed1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f35ed8 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788792016.602990:0:18630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788792016.602992:0:18630:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788792016.602995:0:18630:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788792016.603014:0:18630:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c617faf5800 00010000:00010000:1.0:1788792016.603019:0:18630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c6141689000/0x4d37c11031f35ed1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4d37c11031f35ed8 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792016.603026:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c6141689000/0x4d37c11031f35ed1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4d37c11031f35ed8 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792016.603074:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792016.603076:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792016.603078:0:18630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788792016.603793:0:17084:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788792016.604056:0:17084:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c617faf5800 00010000:00010000:2.0:1788792016.604064:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f35ce0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4d37c11031f35ce7 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792016.604074:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f35ce0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4d37c11031f35ce7 expref: -99 pid: 19418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792016.604098:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792016.604100:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792016.604102:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788792016.611632:0:21275:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c6175e1ed80 - data ffff8c6160718ca8/ffff8c617bf9c000 00000020:01000000:3.0:1788792016.611854:0:21275:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c6174f3b180 - data ffff8c615da6ed80/ffff8c617bf9e400 00100000:10000000:3.0:1788792016.632202:0:21275:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788792016.673986:0:21275:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35cf5 00000020:00000080:2.0:1788792016.673997:0:21275:0:(genops.c:885:class_export_put()) final put ffff8c6143939000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788792016.674017:0:21275:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c617bfbd800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788792016.674021:0:21275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c617bfbd800 2 00000020:01000004:2.0:1788792016.674024:0:21275:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c617bfbd800 from lustre-OST0001 00000020:00000080:2.0:1788792016.674059:0:21275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788792016.674070:0:21275:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788792016.674073:0:21275:0:(genops.c:885:class_export_put()) final put ffff8c617bd63000/lustre-OST0001_UUID 00000020:00000080:2.0:1788792016.674076:0:21275:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617bd63000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788792016.674082:0:21275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788792016.674161:0:21275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 1b5ad001-761f-497e-bfbf-b3c6140a93fd->MGS 00010000:00010000:2.0:1788792016.674176:0:21275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c60430af000/0x4d37c11031f35a39 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f35a40 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788792016.674188:0:21275:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c60430af000/0x4d37c11031f35a39 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f35a40 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788792016.674267:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c6143939000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:2.0:1788792016.674364:0:21275:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788792016.674367:0:21275:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788792016.674370:0:21275:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788792016.674386:0:21275:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c617faf5800 00010000:00010000:2.0:1788792016.674390:0:21275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c60430af000/0x4d37c11031f35a39 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4d37c11031f35a40 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792016.674456:0:21275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8e00/0x4d37c11031f35928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4d37c11031f3592f expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788792016.674473:0:21275:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8e00/0x4d37c11031f35928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4d37c11031f3592f expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792016.674479:0:21275:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788792016.674481:0:21275:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788792016.674483:0:21275:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788792016.674492:0:21275:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c617faf5800 00010000:00010000:0.0:1788792016.674495:0:21275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c6175ee8e00/0x4d37c11031f35928 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4d37c11031f3592f expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788792016.674512:0:21275:0:(import.c:65:import_set_state_nolock()) ffff8c617faf5800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788792016.674515:0:21275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788792016.674518:0:21275:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788792016.674519:0:21275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788792016.674523:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788792016.674533:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c604370aa00 x1875683785808896/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788792031 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788792016.674553:0:21275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788792016.674556:0:21275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788792016.674611:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1b5ad001-761f-497e-bfbf-b3c6140a93fd:3640:1875683785808896:0@lo:250:kworker.0 10000000:01000000:0.0:1788792016.674666:0:21275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788792016.674673:0:21275:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35913 00000020:00000080:0.0:1788792016.674677:0:21275:0:(genops.c:885:class_export_put()) final put ffff8c617faf7000/1b5ad001-761f-497e-bfbf-b3c6140a93fd 00000020:01000000:0.0:1788792016.674691:0:21275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.120@tcp (flags='') 00000020:00000080:0.0:1788792016.674695:0:21275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788792016.674699:0:21275:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.120@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788792016.674703:0:21275:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8c60424a8000) has no exports 00000020:00000080:1.0:1788792016.674743:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617faf7000/1b5ad001-761f-497e-bfbf-b3c6140a93fd for MGC192.168.201.120@tcp 10000000:01000000:2.0:1788792016.674900:0:17092:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788792016.675003:0:21275:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.120@tcp: client import never connected 00000100:00080000:0.0:1788792016.675006:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788792016.675008:0:21275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788792016.675010:0:21275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788792016.675017:0:21275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788792016.675061:0:21275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788792016.675066:0:21275:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.120@tcp (uuid 1b5ad001-761f-497e-bfbf-b3c6140a93fd) 00000020:01000000:0.0:1788792016.675071:0:21275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788792016.675073:0:21275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788792016.675077:0:21275:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788792016.675081:0:21275:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8c61812b4000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788792016.675086:0:21275:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8c6042188000) has exports, disconnecting them 00000020:00080000:0.0:1788792016.675090:0:21275:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8c61812b4000), last request at 1788791929 00000020:00000080:0.0:1788792016.675093:0:21275:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35d1f 00000020:00080000:0.0:1788792016.675103:0:21275:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c61812b4000): rc 0 00000020:00000080:0.0:1788792016.675106:0:21275:0:(genops.c:885:class_export_put()) final put ffff8c61812b4000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788792016.675264:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c617faf5800 for MGC192.168.201.120@tcp 00000020:00000080:1.0:1788792016.675271:0:37:0:(genops.c:885:class_export_put()) final put ffff8c617faf6000/1b5ad001-761f-497e-bfbf-b3c6140a93fd 00000020:00000080:1.0:1788792016.675273:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617faf6000/1b5ad001-761f-497e-bfbf-b3c6140a93fd for MGC192.168.201.120@tcp 00000020:01000000:1.0:1788792016.675278:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.120@tcp (1b5ad001-761f-497e-bfbf-b3c6140a93fd) 00000020:00000080:1.0:1788792016.675523:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c61812b4000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788792016.677952:0:21275:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788792016.677966:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788792016.677970:0:21275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788792016.677978:0:21275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788792016.678009:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c60420b7000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788792016.678200:0:21275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788792016.678208:0:21275:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788792016.678213:0:21275:0:(genops.c:885:class_export_put()) final put ffff8c60420b2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788792016.678217:0:21275:0:(genops.c:844:class_export_destroy()) destroying export ffff8c60420b2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788792016.678223:0:21275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788792016.678290:0:21275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788792016.678294:0:21275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788792016.678308:0:21275:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788792016.678315:0:21275:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8c604377c800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788792016.678320:0:21275:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8c6150e24d28) has exports, disconnecting them 00000020:00080000:1.0:1788792016.678335:0:21275:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8c604377c800), last request at 1788791929 00000020:00000080:1.0:1788792016.678339:0:21275:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35d34 00000020:00080000:1.0:1788792016.678352:0:21275:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c604377c800): rc 0 00000020:00000080:1.0:1788792016.678356:0:21275:0:(genops.c:885:class_export_put()) final put ffff8c604377c800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788792016.678763:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c604377c800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788792016.683045:0:21275:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788792016.683056:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788792016.683060:0:21275:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788792016.683069:0:21275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788792016.683106:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c604377b800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788792016.687846:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788792016.690957:0:18630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788792016.691136:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788792016.691270:0:17080:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8c60425c7400:17080] 1 exiting: rc = 0 00000100:00100000:1.0:1788792016.693681:0:17079:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8c60425c6800:17079] 0 exiting: rc = 1 00000100:00100000:2.0:1788792016.693868:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.694181:0:17081:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8c60425c7c00:17081] 0 exiting: rc = 1 00000100:00100000:2.0:1788792016.695061:0:17083:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8c60425c7600:17083] 2 exiting: rc = 0 00000100:00100000:2.0:1788792016.697139:0:17082:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8c60425c6c00:17082] 1 exiting: rc = 0 00000100:00100000:1.0:1788792016.701252:0:20238:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8c6181274400:20238] 3 exiting: rc = 0 00000100:00100000:2.0:1788792016.701348:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701364:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701379:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701386:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701394:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701403:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701409:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701430:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701435:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701441:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701447:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701452:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701459:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701465:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701470:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701476:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701482:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701488:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701494:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701499:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701505:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701510:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701516:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701522:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701529:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701546:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701552:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701557:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701562:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701568:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701574:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701579:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701585:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701592:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701598:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701604:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701611:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701617:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701622:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701629:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701635:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701639:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701653:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701658:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701664:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701669:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701675:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701681:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701686:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701693:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701699:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701704:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701710:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701716:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701721:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701726:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701733:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701738:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701744:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701750:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701756:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701761:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701767:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.701772:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788792016.702628:0:21275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788792016.702640:0:21275:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788792016.702647:0:21275:0:(genops.c:885:class_export_put()) final put ffff8c604377a000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788792016.702652:0:21275:0:(genops.c:844:class_export_destroy()) destroying export ffff8c604377a000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788792016.702658:0:21275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788792016.702713:0:21275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c617bfbd800 1 00000020:00000080:2.0:1788792016.702720:0:21275:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4d37c11031f35cd9 00000020:00000080:2.0:1788792016.702725:0:21275:0:(genops.c:885:class_export_put()) final put ffff8c61812b3800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788792016.702738:0:21275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788792016.702748:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c61812b3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788792016.702760:0:21275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788792016.702773:0:21275:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788792016.702778:0:21275:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff8c61714dcd28) has no exports 00000020:00000080:2.0:1788792016.775063:0:21275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788792016.775079:0:21275:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788792016.775085:0:21275:0:(genops.c:885:class_export_put()) final put ffff8c617bfb9000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788792016.775090:0:21275:0:(genops.c:844:class_export_destroy()) destroying export ffff8c617bfb9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788792016.775101:0:21275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788792016.778161:0:21275:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c617bfb9800 00000020:01000000:2.0:1788792016.778270:0:21275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788792016.778279:0:21275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788792016.778285:0:21275:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788792016.778290:0:21275:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8c61714d8000) has no exports 00000020:00000080:2.0:1788792016.778339:0:21275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788792016.778348:0:21275:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788792016.778353:0:21275:0:(genops.c:885:class_export_put()) final put ffff8c61601ca000/OSS_uuid 00000020:00000080:2.0:1788792016.778357:0:21275:0:(genops.c:844:class_export_destroy()) destroying export ffff8c61601ca000/OSS_uuid for OSS 00000020:01000000:2.0:1788792016.778362:0:21275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788792016.778779:0:18606:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8c6170d74600:18606] 2 exiting: rc = 0 00000100:00100000:1.0:1788792016.778790:0:19084:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8c604274b200:19084] 3 exiting: rc = 0 00000100:00100000:3.0:1788792016.778915:0:18605:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8c604369da00:18605] 1 exiting: rc = 0 00000100:00080000:0.0:1788792016.780918:0:17091:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788792016.790070:0:18603:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8c61714ff800:18603] 0 exiting: rc = 1 00000100:00100000:2.0:1788792016.827065:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827080:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827086:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827092:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827097:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827103:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827109:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827115:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827121:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827127:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827135:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827141:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827146:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827152:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827157:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827163:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.827169:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828152:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828167:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828173:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828179:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828185:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828324:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828331:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828336:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828341:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828346:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828351:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828357:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828362:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828367:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828372:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828377:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828382:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828405:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828411:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828417:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828422:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828426:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828432:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828437:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828442:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828447:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828451:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828457:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828462:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828466:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828471:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828477:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828483:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828488:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828493:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828511:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828516:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828522:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.828528:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.829283:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.829304:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.829311:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.829317:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.829323:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.829329:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.829334:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.829340:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832371:0:18608:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8c616d349600:18608] 1 exiting: rc = 0 00000100:00100000:2.0:1788792016.832474:0:18607:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8c616d349800:18607] 0 exiting: rc = 1 00000100:00100000:2.0:1788792016.832555:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832573:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832696:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832706:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832712:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832717:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832723:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832728:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832733:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832738:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832743:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832819:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832825:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832829:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832834:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832840:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832844:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832849:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832855:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832860:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832947:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832969:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832974:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832979:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832984:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832988:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832993:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.832998:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833003:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833013:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833023:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833030:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833035:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833041:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833047:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833053:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833059:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833064:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833068:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833073:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833078:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833083:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833088:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833094:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833099:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833104:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833108:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833119:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833126:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833132:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833137:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833143:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833148:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833154:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833160:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833166:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833176:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833181:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833452:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833462:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833468:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833473:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833478:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.833489:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.839854:0:20240:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8c617cc2ba00:20240] 3 exiting: rc = 0 00000100:00100000:1.0:1788792016.840716:0:18610:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8c616d349200:18610] 1 exiting: rc = 0 00000100:00100000:3.0:1788792016.841525:0:18611:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8c616d348c00:18611] 2 exiting: rc = 0 00000100:00100000:0.0:1788792016.842120:0:18609:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8c616d348000:18609] 0 exiting: rc = 1 00000100:00100000:2.0:1788792016.842703:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842713:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842720:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842726:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842731:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842781:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842788:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842794:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842800:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842805:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842811:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842818:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842823:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842830:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842836:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842842:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842848:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842855:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.842861:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843460:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843470:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843477:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843484:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843492:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843498:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843506:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843526:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843678:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843686:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843707:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843714:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843720:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843726:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843732:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843738:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843754:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843760:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843767:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843774:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843781:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843786:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843791:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843796:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843802:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843809:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843814:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843820:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843827:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843834:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843840:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843847:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843853:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843859:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843865:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843928:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843935:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843940:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843946:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843961:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843969:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843975:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843989:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.843995:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.844010:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.864129:0:18612:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8c6175d06a00:18612] 0 exiting: rc = 1 00000100:00100000:3.0:1788792016.865037:0:18613:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8c6175d06200:18613] 1 exiting: rc = 0 00000100:00100000:2.0:1788792016.865718:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.865730:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.865737:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866263:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866276:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866282:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866287:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866292:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866309:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866315:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866320:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866327:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866332:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866337:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866343:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866348:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866354:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866359:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866366:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866370:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866375:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866380:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866385:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866390:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866395:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866399:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866404:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866409:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866414:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866419:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866424:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866446:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866452:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866457:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866462:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866467:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866473:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866479:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866484:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866489:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866494:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866500:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866506:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866511:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866516:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866522:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866527:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866533:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866538:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866543:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866558:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866649:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866657:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866662:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866668:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866673:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866677:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866683:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866688:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866693:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866697:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866702:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866706:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.866711:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.869928:0:18615:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8c61714a4600:18615] 1 exiting: rc = 0 00000100:00100000:2.0:1788792016.871153:0:18614:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8c61714a5000:18614] 0 exiting: rc = 1 00000100:00100000:2.0:1788792016.871303:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871315:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871321:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871327:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871333:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871360:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871368:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871375:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871383:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871389:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871395:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871402:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871408:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871414:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871420:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871427:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871432:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871453:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871461:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871467:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871473:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871479:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871485:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871491:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871497:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871504:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871510:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871516:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871521:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871542:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871549:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871556:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871570:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871577:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871828:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871844:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871850:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871857:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871864:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871962:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871968:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871989:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.871997:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872003:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872008:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872014:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872019:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872026:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872031:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872037:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872043:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872050:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872056:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872077:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872085:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872091:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872096:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872103:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872108:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872114:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872120:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872125:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872132:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788792016.872146:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788792016.930816:0:21275:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788792041.403826:0:22042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788792054.672498:0:22643:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788792054.672504:0:22643:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788792054.672506:0:22643:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788792054.672640:0:22643:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c617fa8f000 00000020:01000004:2.0:1788792054.672656:0:22643:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788792054.672664:0:22643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788792054.672720:0:22643:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8c604218cd28) 00000020:00000080:2.0:1788792054.672734:0:22643:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788792054.727229:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788792054.728071:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.730645:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.731047:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.731310:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.731533:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.731760:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.732536:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.732961:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.733180:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.733389:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.733589:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.733967:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.734210:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.734456:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.734701:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.735099:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.735357:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.735581:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.735916:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.736214:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.736422:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.736625:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.737132:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.737403:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.737615:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.738018:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.738432:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.738700:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.739354:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.739583:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.739988:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.740260:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788792054.740459:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788792054.741251:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788792054.742202:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788792054.742560:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788792054.743032:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788792054.743311:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788792054.743505:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788792054.743976:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788792054.744208:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788792054.744409:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788792054.744685:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788792054.745209:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788792054.745588:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788792054.747720:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788792054.748718:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788792054.750229:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788792054.750684:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788792054.751464:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788792054.751725:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788792054.752166:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1788792054.753525:0:22643:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788792054.753972:0:22643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788792054.753984:0:22643:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788792054.753998:0:22643:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4d37c11031f36186 00000020:01000004:2.0:1788792054.754008:0:22643:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788792054.754013:0:22643:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788792054.754018:0:22643:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c617fa8f000 from MGS 00000020:01000004:2.0:1788792054.754022:0:22643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788792054.754033:0:22643:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8c60421899b8) 00000020:00000080:2.0:1788792054.754043:0:22643:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788792054.754163:0:22643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c617fa8f000 from MGS, refs=2 00080000:01000000:2.0:1788792054.754169:0:22643:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788792054.754174:0:22643:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4d37c11031f36194 00000100:00100000:2.0:1788792054.754276:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788792054.754408:0:22643:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788792054.754415:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788792054.755462:0:22643:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788792054.755472:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788792054.756443:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788792054.756597:0:22643:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788792054.756602:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788792054.761354:0:22643:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788792054.761368:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788792054.762199:0:22643:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788792054.762207:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788792054.763478:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792054.763482:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792054.763484:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792054.763977:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792054.763980:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792054.763981:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792054.765048:0:22643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788792054.767017:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788792054.772407:0:22643:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788792054.785238:0:22656:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788792054.785296:0:22643:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788792054.785366:0:22643:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788792054.786441:0:22643:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788792054.787234:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788792054.787418:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788792054.787425:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788792054.788585:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788792054.788596:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788792054.789416:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788792054.789426:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788792054.791761:0:22643:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788792054.791800:0:22643:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.120@tcp' 00000020:01000004:2.0:1788792054.791802:0:22643:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788792054.791843:0:22643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.120@tcp (typ=mgc) 00000020:00000080:2.0:1788792054.791859:0:22643:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.120@tcp (ffff8c604218b370) 00000020:00000080:2.0:1788792054.791895:0:22643:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788792054.791996:0:22643:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c6143a8d800@MGC192.168.201.120@tcp: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788792054.792356:0:22643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.120@tcp-0 is initialized 00000040:01000000:2.0:1788792054.792365:0:22643:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788792054.793335:0:22660:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788792054.793425:0:22661:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788792054.793502:0:22643:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.120@tcp (uuid a140336d-9a80-41e1-97b0-93600c05b204) 00000020:00000080:0.0:1788792054.793523:0:22643:0:(genops.c:1385:class_connect()) connect: client a140336d-9a80-41e1-97b0-93600c05b204, cookie 0x4d37c11031f361a2 00000100:00080000:0.0:1788792054.793537:0:22643:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788792054.793544:0:22643:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8c6143a8d800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788792054.793581:0:22643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043dc8000 x1875683785809024/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788792054.793641:0:22643:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a140336d-9a80-41e1-97b0-93600c05b204->MGS 00000020:01000004:0.0:1788792054.793669:0:22643:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788792054.793675:0:22643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788792054.793689:0:22643:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8c61714db370) 00000020:00000080:0.0:1788792054.793701:0:22643:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788792054.793911:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a140336d-9a80-41e1-97b0-93600c05b204:3640:1875683785809024:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788792054.793982:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792054.794049:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785809024 00000100:00100000:1.0:1788792054.794057:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785809024 00000100:00100000:1.0:1788792054.794400:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788792054.794408:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1875683785809024:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788792054.794433:0:22657:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a140336d-9a80-41e1-97b0-93600c05b204@0@lo t0 exp 0000000000000000 cur 697 last 0 00000020:00000080:1.0:1788792054.794456:0:22657:0:(genops.c:1385:class_connect()) connect: client a140336d-9a80-41e1-97b0-93600c05b204, cookie 0x4d37c11031f361b0 00000100:00080000:1.0:1788792054.794598:0:22657:0:(import.c:65:import_set_state_nolock()) ffff8c6044e6e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788792054.794684:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+5:3640:x1875683785809024:12345-0@lo:250:mount.lustre.0 Request processed in 274us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792054.794692:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788792054.794845:0:3640:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788792054.794856:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.120@tcp: connect to target with instance 0 00000100:00080000:2.0:1788792054.794865:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788792054.794869:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788792054.794894:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6143a8d800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788792054.794897:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788792054.794905:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788792054.794911:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a140336d-9a80-41e1-97b0-93600c05b204:3640:1875683785809024:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788792054.814715:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788792054.815023:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788792054.815030:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788792054.823069:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788792054.823085:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788792054.823854:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788792054.823862:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788792054.824998:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788792054.825168:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788792054.825173:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788792054.826411:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788792054.826421:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788792054.857514:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788792054.857774:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788792054.857781:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788792054.861480:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788792054.861500:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788792054.862319:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788792054.862476:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788792054.862480:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788792054.865539:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788792054.865556:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788792054.866772:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788792054.867488:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788792054.867495:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788792054.868449:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788792054.868458:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788792054.869358:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788792054.869538:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788792054.869543:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788792054.870581:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788792054.870592:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788792054.903799:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788792054.904762:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788792054.904771:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788792054.908610:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788792054.908638:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788792054.910404:0:22643:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788792054.910422:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788792054.912746:0:22643:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788792054.912781:0:22643:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788792054.912787:0:22643:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788792054.917497:0:22643:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788792054.917546:0:22643:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788792054.917557:0:22643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788792054.917558:0:22643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788792054.917560:0:22643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788792054.917561:0:22643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788792054.917562:0:22643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788792054.917563:0:22643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788792054.917564:0:22643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788792054.917566:0:22643:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788792054.917568:0:22643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788792054.917569:0:22643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788792054.917572:0:22643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788792054.917574:0:22643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788792054.917575:0:22643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788792054.917576:0:22643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788792054.917577:0:22643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788792054.917578:0:22643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788792054.917578:0:22643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788792054.917579:0:22643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788792054.917580:0:22643:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788792054.917581:0:22643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788792054.917582:0:22643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788792054.917645:0:22643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788792054.918056:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785809152:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788792054.918202:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792054.918288:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c617fb45900 going to sleep for 11 seconds 00000100:00100000:3.0:1788792054.918360:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785809152 00000100:00100000:3.0:1788792054.918373:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785809152 00000100:00100000:3.0:1788792054.918472:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788792054.918483:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+5:22643:x1875683785809152:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788792054.918535:0:22659:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788792054.918540:0:22659:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788792054.918543:0:22659:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788792054.919320:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788792054.920192:0:22659:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1788792054.926349:0:22681:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788792054.926363:0:22681:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788792054.926368:0:22681:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788792054.926371:0:22681:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788792054.926637:0:22681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788792054.929832:0:22659:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788792054.929850:0:22659:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788792054.932646:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+5:22643:x1875683785809152:12345-0@lo:253:mount.lustre.0 Request processed in 14145us (14425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792054.932672:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788792054.932810:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785809152:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788792054.932838:0:22643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788792054.932842:0:22643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788792054.932844:0:22643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788792054.932845:0:22643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788792054.932846:0:22643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788792054.932847:0:22643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788792054.932848:0:22643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788792054.932849:0:22643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788792054.932851:0:22643:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788792054.932852:0:22643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788792054.932854:0:22643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788792054.932931:0:22643:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c617fa8f000 from lustre-MDT0000 10000000:01000000:1.0:1788792054.932979:0:22643:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788792054.932983:0:22643:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788792054.932989:0:22643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c604218b370 10000000:01000000:1.0:1788792054.932994:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788792054.933003:0:22643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c604218b370 from 1 10000000:01000000:1.0:1788792054.933007:0:22643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788792054.933059:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792054.933070:0:22643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792054.933094:0:22643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792054.933117:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785809280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788792054.933157:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792054.933196:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c617fb45e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788792054.933294:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785809280 00000100:00100000:2.0:1788792054.933303:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785809280 00000100:00100000:2.0:1788792054.933355:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788792054.933366:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+5:22643:x1875683785809280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788792054.933382:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792054.933399:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c618217ea00/0x4d37c11031f361be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f361b7 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792054.933426:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c618217ea00/0x4d37c11031f361be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f361b7 expref: 6 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792054.933437:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c618217ea00/0x4d37c11031f361be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f361b7 expref: 6 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792054.933459:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c618217ea00, rc 0) 00000100:00100000:2.0:1788792054.933506:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+6:22643:x1875683785809280:12345-0@lo:101:mount.lustre.0 Request processed in 142us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792054.933512:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788792054.933929:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785809280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788792054.933947:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361be expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792054.933957:0:22643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f361be expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792054.934031:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785809408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788792054.934064:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792054.934113:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6143952cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788792054.934183:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785809408 00000100:00100000:0.0:1788792054.934190:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785809408 00000100:00100000:0.0:1788792054.934225:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788792054.934233:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604316a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+6:22643:x1875683785809408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788792054.934325:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604316a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+6:22643:x1875683785809408:12345-0@lo:501:mount.lustre.0 Request processed in 93us (260us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788792054.934347:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788792054.934539:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785809408:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788792054.934575:0:22643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788792054.934597:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361be expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792054.934606:0:22643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361be expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788792054.934614:0:22643:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c617fa8f000 10000000:01000000:3.0:1788792054.934619:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788792054.934634:0:22643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c617fa8f000 10000000:01000000:3.0:1788792054.934638:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788792054.934641:0:22643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8c617fa8f000 from 1 10000000:01000000:3.0:1788792054.934644:0:22643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788792054.934678:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6181363c00/0x4d37c11031f361c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792054.934692:0:22643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c6181363c00/0x4d37c11031f361c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792054.934701:0:22643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c6181363c00/0x4d37c11031f361c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792054.934715:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785809536:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788792054.934741:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792054.934763:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6143952cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788792054.935011:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785809536 00000100:00100000:2.0:1788792054.935016:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785809536 00000100:00100000:2.0:1788792054.935049:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788792054.935057:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604316ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+6:22643:x1875683785809536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788792054.935067:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792054.935095:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c618217fe00/0x4d37c11031f361cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f361c5 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792054.935113:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c618217fe00/0x4d37c11031f361cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f361c5 expref: 7 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792054.935123:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c618217fe00/0x4d37c11031f361cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f361c5 expref: 7 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792054.935131:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c618217fe00, rc 0) 00000100:00100000:2.0:1788792054.935163:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604316ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+7:22643:x1875683785809536:12345-0@lo:101:mount.lustre.0 Request processed in 108us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792054.935169:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788792054.935309:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785809536:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788792054.935321:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c6181363c00/0x4d37c11031f361c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361cc expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792054.935330:0:22643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c6181363c00/0x4d37c11031f361c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f361cc expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788792054.935344:0:22643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788792054.935348:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6181363c00/0x4d37c11031f361c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361cc expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792054.935355:0:22643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6181363c00/0x4d37c11031f361c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361cc expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788792054.935362:0:22643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788792054.935365:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788792054.935370:0:22643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c617fa8f000 10000000:01000000:3.0:1788792054.935373:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788792054.935387:0:22643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788792054.935389:0:22643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788792054.935407:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6181363200/0x4d37c11031f361d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792054.935414:0:22643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c6181363200/0x4d37c11031f361d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792054.935422:0:22643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c6181363200/0x4d37c11031f361d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792054.935435:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785809664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788792054.935462:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792054.935489:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6143952cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788792054.935611:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785809664 00000100:00100000:1.0:1788792054.935617:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785809664 00000100:00100000:1.0:1788792054.935672:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788792054.935682:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604316b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+7:22643:x1875683785809664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788792054.935691:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788792054.935703:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6141688600/0x4d37c11031f361da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f361d3 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792054.935718:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6141688600/0x4d37c11031f361da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f361d3 expref: 8 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792054.935728:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6141688600/0x4d37c11031f361da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f361d3 expref: 8 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792054.935742:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6141688600, rc 0) 00000100:00100000:1.0:1788792054.935780:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604316b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+8:22643:x1875683785809664:12345-0@lo:101:mount.lustre.0 Request processed in 100us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792054.935786:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788792054.936249:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785809664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788792054.936263:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c6181363200/0x4d37c11031f361d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361da expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792054.936273:0:22643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c6181363200/0x4d37c11031f361d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f361da expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792054.936336:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785809792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788792054.936368:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792054.936401:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6143952cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788792054.936580:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785809792 00000100:00100000:1.0:1788792054.936586:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785809792 00000100:00100000:1.0:1788792054.936675:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788792054.936694:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+8:22643:x1875683785809792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788792054.936911:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+9:22643:x1875683785809792:12345-0@lo:501:mount.lustre.0 Request processed in 228us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792054.936919:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788792054.937000:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785809792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788792054.937032:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785809920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788792054.937088:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792054.938293:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6143952cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788792054.938379:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785809920 00000100:00100000:0.0:1788792054.938387:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785809920 00000100:00100000:0.0:1788792054.938431:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788792054.938440:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+9:22643:x1875683785809920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788792054.941480:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+9:22643:x1875683785809920:12345-0@lo:503:mount.lustre.0 Request processed in 3029us (4390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792054.941497:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788792054.941678:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785809920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788792054.943448:0:22682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a140336d-9a80-41e1-97b0-93600c05b204:22682:1875683785810048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788792054.943581:0:22682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792054.943701:0:22682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6150f9a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788792054.944308:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785810048 00000100:00100000:3.0:1788792054.944320:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785810048 00000100:00100000:1.0:1788792054.944422:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788792054.944435:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+9:22682:x1875683785810048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788792054.945756:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+9:22682:x1875683785810048:12345-0@lo:502:llog_process_th.0 Request processed in 1313us (2165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792054.945770:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788792054.946016:0:22682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a140336d-9a80-41e1-97b0-93600c05b204:22682:1875683785810048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788792054.946057:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788792054.946069:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792054.946072:0:22682:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788792054.946088:0:22682:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788792054.946092:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788792054.946109:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8c61714d8000) 00000020:00000080:0.0:1788792054.946127:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788792054.946134:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788792054.946242:0:22682:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788792054.946251:0:22682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4d37c11031f361e8 00000020:00000080:0.0:1788792054.946480:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788792054.946485:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788792054.946490:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792054.946491:0:22682:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788792054.946494:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788792054.946498:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792054.946500:0:22682:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788792054.946510:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788792054.946518:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8c61714dcd28) 00000020:00000080:0.0:1788792054.946528:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788792054.946533:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788792054.946535:0:22682:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788792054.946538:0:22682:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788792054.946546:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788792054.946589:0:22682:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c617fa8f000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788792054.946603:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8c61714d99b8) 00000020:00000080:0.0:1788792054.946611:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788792054.946695:0:22682:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788792054.946702:0:22682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4d37c11031f361fd 00000020:00000080:0.0:1788792054.946795:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788792054.946802:0:22682:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788792054.946806:0:22682:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4d37c11031f36204 00080000:01000000:0.0:1788792054.946811:0:22682:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788792054.947230:0:22682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4d37c11031f3620b 00010000:00010000:2.0:1788792055.048162:0:22682:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788792055.048726:0:22682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:2.0:1788792055.049993:0:22682:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788792055.056275:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8c6042188000) 00000020:00000080:2.0:1788792055.056308:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788792055.056463:0:22682:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788792055.056473:0:22682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4d37c11031f36219 00000020:00000080:0.0:1788792055.058496:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788792055.074506:0:22682:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4d37c11031f36220 00000020:00000080:1.0:1788792055.075389:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788792055.075401:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792055.075407:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792055.075410:0:22682:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788792055.075414:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788792055.075417:0:22682:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788792055.075418:0:22682:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788792055.075420:0:22682:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788792055.075421:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788792055.075423:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792055.075425:0:22682:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788792055.075438:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788792055.075443:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792055.075444:0:22682:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788792055.075448:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788792055.075495:0:22682:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788792055.075513:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792055.075517:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792055.075518:0:22682:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788792055.075521:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788792055.075523:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792055.075525:0:22682:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788792055.075528:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788792055.075533:0:22682:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:00000080:1.0:1788792055.075574:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788792055.075592:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8c6150e219b8) 00000020:00000080:1.0:1788792055.075607:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788792055.075612:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788792055.075675:0:22682:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788792055.075681:0:22682:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788792055.075688:0:22682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4d37c11031f3622e 00010000:00080000:1.0:1788792055.075722:0:22682:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c61813c7000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788792055.078394:0:22682:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788792055.082061:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788792055.082076:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788792055.082131:0:22682:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788792055.082151:0:22682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4d37c11031f36235 00000100:00080000:0.0:1788792055.082161:0:22682:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788792055.082168:0:22682:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c61813c7000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788792055.082419:0:22682:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043dc8000 x1875683785810176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788792055.082445:0:22682:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788792055.082493:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785810176:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788792055.082526:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788792055.082531:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792055.082534:0:22682:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788792055.082544:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788792055.082547:0:22682:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788792055.082549:0:22682:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788792055.082550:0:22682:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788792055.082552:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788792055.082554:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792055.082556:0:22682:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788792055.082558:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788792055.082563:0:22682:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788792055.082567:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792055.082568:0:22682:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788792055.082571:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788792055.082575:0:22682:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000100:00100000:3.0:1788792055.082600:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a140336d-9a80-41e1-97b0-93600c05b204:3644:1875683785810304:0@lo:400:kworker.0 00000020:01000000:0.0:1788792055.082602:0:22682:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788792055.082605:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788792055.082620:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c60433e19b8) 00000020:00000080:0.0:1788792055.082643:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788792055.082648:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1788792055.082692:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788792055.082716:0:22682:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788792055.082722:0:22682:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000100:00100000:3.0:1788792055.082803:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785810304 00000020:00000080:0.0:1788792055.082808:0:22682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4d37c11031f36243 00000100:00100000:3.0:1788792055.082810:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785810304 00000100:00100000:3.0:1788792055.082855:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788792055.082865:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+9:3644:x1875683785810304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792055.082955:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+9:3644:x1875683785810304:12345-0@lo:400:kworker.0 Request processed in 91us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792055.082963:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788792055.082994:0:22682:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c6174caa000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.120@tcp at head 00000100:00100000:3.0:1788792055.083012:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a140336d-9a80-41e1-97b0-93600c05b204:3644:1875683785810304:0@lo:400:kworker.0 00010000:00010000:0.0:1788792055.083206:0:22682:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1788792055.083474:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792055.083842:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785810176 00000100:00100000:1.0:1788792055.083848:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785810176 00000100:00100000:1.0:1788792055.083973:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788792055.083982:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875683785810176:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1788792055.084002:0:22669:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1788792055.084487:0:22682:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788792055.085047:0:22682:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788792055.088636:0:22682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788792055.089419:0:22682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788792055.094066:0:22682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788792055.094830:0:22688:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788792055.094835:0:22688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788792055.096747:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788792055.096761:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788792055.096800:0:22682:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788792055.096823:0:22682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4d37c11031f3624a 00000100:00080000:0.0:1788792055.096832:0:22682:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788792055.096846:0:22682:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c6174caa000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788792055.097103:0:22682:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043dca300 x1875683785810432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788792055.097219:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785810432:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788792055.097278:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683785810432 offset 0 length 520: 4 00000100:00080000:0.0:1788792055.097335:0:22682:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788792055.097393:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788792055.097398:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792055.097400:0:22682:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788792055.097404:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788792055.097406:0:22682:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788792055.097408:0:22682:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788792055.097409:0:22682:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788792055.097411:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788792055.097413:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792055.097415:0:22682:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788792055.097417:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788792055.097422:0:22682:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788792055.097425:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792055.097427:0:22682:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788792055.097430:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788792055.097434:0:22682:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:0.0:1788792055.097456:0:22682:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788792055.097459:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788792055.097473:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c60433e4d28) 00000020:00000080:0.0:1788792055.097485:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1788792055.097490:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788792055.097569:0:22682:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788792055.097576:0:22682:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788792055.097584:0:22682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4d37c11031f36258 00010000:00080000:0.0:1788792055.097616:0:22682:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c6043732000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:0.0:1788792055.097831:0:22682:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788792055.097934:0:22682:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788792055.097961:0:22682:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788792055.100775:0:22682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788792055.101456:0:22682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788792055.102536:0:22682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:0.0:1788792055.104867:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875683785810176:12345-0@lo:38:llog_process_th.0 Request processed in 20879us (21386us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788792055.104906:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788792055.104932:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c61813c7000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788792055.104939:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788792055.104944:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785810176:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788792055.106702:0:22690:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788792055.106718:0:22690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788792055.107556:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788792055.107567:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788792055.107601:0:22682:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788792055.107618:0:22682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4d37c11031f3625f 00000100:00080000:2.0:1788792055.107638:0:22682:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788792055.107643:0:22682:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c6043732000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788792055.107685:0:22682:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c604370ad80 x1875683785810560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788792055.107712:0:22682:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788792055.107762:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788792055.107766:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788792055.107768:0:22682:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788792055.107771:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788792055.107775:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788792055.107776:0:22682:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788792055.107779:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788792055.107780:0:22682:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788792055.107782:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788792055.107784:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788792055.107791:0:22682:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788792055.107794:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788792055.107797:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788792055.107799:0:22682:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788792055.107802:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788792055.107835:0:22682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a140336d-9a80-41e1-97b0-93600c05b204:22682:1875683785810688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788792055.107938:0:22682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792055.108056:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785810560:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788792055.108112:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785810688 00000100:00100000:0.0:1788792055.108119:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785810688 00000100:00100000:0.0:1788792055.108165:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788792055.108175:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+9:22682:x1875683785810688:12345-0@lo:502:llog_process_th.0 00000400:00000100:3.0:1788792055.110126:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683785810560 offset 0 length 520: 4 00000100:00100000:2.0:1788792055.110609:0:22682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6145f66cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788792055.111138:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+9:22682:x1875683785810688:12345-0@lo:502:llog_process_th.0 Request processed in 2959us (3195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792055.111152:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788792055.111348:0:22682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a140336d-9a80-41e1-97b0-93600c05b204:22682:1875683785810688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788792055.111468:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788792055.111480:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792055.111484:0:22682:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788792055.111489:0:22682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788792055.111705:0:22643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788792055.112150:0:22643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788792055.112173:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6181363200/0x4d37c11031f361d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361da expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792055.112186:0:22643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6181363200/0x4d37c11031f361d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361da expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792055.112196:0:22643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c617fa8f000 from 1 10000000:01000000:0.0:1788792055.112199:0:22643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788792055.112255:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792055.112264:0:22643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792055.112295:0:22643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792055.112320:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785810816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788792055.112378:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792055.112420:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6142f47f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788792055.112486:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785810816 00000100:00100000:3.0:1788792055.112502:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785810816 00000100:00100000:3.0:1788792055.112557:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788792055.112568:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+9:22643:x1875683785810816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788792055.112582:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792055.112597:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6181363400/0x4d37c11031f3626d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f36266 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792055.112633:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6181363400/0x4d37c11031f3626d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f36266 expref: 10 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792055.112645:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6181363400/0x4d37c11031f3626d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36266 expref: 10 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792055.112655:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6181363400, rc 0) 00000100:00100000:3.0:1788792055.112695:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+10:22643:x1875683785810816:12345-0@lo:101:mount.lustre.0 Request processed in 129us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792055.112701:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788792055.114104:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785810816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788792055.114315:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3626d expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792055.114329:0:22643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f3626d expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792055.115363:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785810944:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788792055.115441:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792055.115494:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6142f47f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788792055.115606:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785810944 00000100:00100000:3.0:1788792055.115615:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785810944 00000100:00100000:3.0:1788792055.115684:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788792055.115695:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+10:22643:x1875683785810944:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788792055.115718:0:22658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788792055.115725:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788792055.115849:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+10:22643:x1875683785810944:12345-0@lo:256:mount.lustre.0 Request processed in 155us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792055.115857:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788792055.116217:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785810944:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788792055.116809:0:22643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788792055.116918:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3626d expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792055.116930:0:22643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3626d expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792055.116939:0:22643:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c617fa8f000 from 1 10000000:01000000:0.0:1788792055.116943:0:22643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788792055.117043:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792055.117051:0:22643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792055.117061:0:22643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792055.117092:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785811072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788792055.117148:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792055.117194:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6142f47f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788792055.119329:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785811072 00000100:00100000:1.0:1788792055.119343:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785811072 00000100:00100000:1.0:1788792055.119401:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788792055.119411:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+10:22643:x1875683785811072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788792055.119442:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788792055.119463:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6141688800/0x4d37c11031f3627b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f36274 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792055.119491:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6141688800/0x4d37c11031f3627b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f36274 expref: 11 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792055.119515:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6141688800/0x4d37c11031f3627b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36274 expref: 11 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792055.119525:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6141688800, rc 0) 00000100:00100000:1.0:1788792055.119608:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+11:22643:x1875683785811072:12345-0@lo:101:mount.lustre.0 Request processed in 199us (2459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792055.119615:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788792055.120210:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785811072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788792055.120230:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3627b expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792055.120240:0:22643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f3627b expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792055.120325:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785811200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788792055.120371:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792055.120451:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6142f47f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788792055.120835:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785811200 00000100:00100000:3.0:1788792055.120842:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785811200 00000100:00100000:3.0:1788792055.120960:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788792055.120996:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+11:22643:x1875683785811200:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788792055.121397:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+11:22643:x1875683785811200:12345-0@lo:501:mount.lustre.0 Request processed in 403us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792055.121407:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788792055.121501:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785811200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788792055.121545:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785811328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788792055.121596:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792055.121868:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6142f47f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788792055.122017:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785811328 00000100:00100000:1.0:1788792055.122023:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785811328 00000100:00100000:1.0:1788792055.122054:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788792055.122062:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+11:22643:x1875683785811328:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788792055.122400:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+11:22643:x1875683785811328:12345-0@lo:503:mount.lustre.0 Request processed in 336us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792055.122408:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788792055.122518:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785811328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788792055.123006:0:22692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a140336d-9a80-41e1-97b0-93600c05b204:22692:1875683785811456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788792055.123047:0:22692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792055.123089:0:22692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6142f47d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788792055.123310:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785811456 00000100:00100000:1.0:1788792055.123316:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785811456 00000100:00100000:1.0:1788792055.123344:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788792055.123352:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+11:22692:x1875683785811456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788792055.123830:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+11:22692:x1875683785811456:12345-0@lo:502:llog_process_th.0 Request processed in 477us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792055.123854:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788792055.123990:0:22692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a140336d-9a80-41e1-97b0-93600c05b204:22692:1875683785811456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788792055.124019:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788792055.124030:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792055.124032:0:22692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788792055.124041:0:22692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c617fa8f000 00000020:00000080:0.0:1788792055.124043:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788792055.124052:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788792055.124055:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792055.124056:0:22692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788792055.124058:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788792055.124060:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792055.124061:0:22692:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788792055.124064:0:22692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c617fa8f000 00000020:00000080:0.0:1788792055.124067:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788792055.124300:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788792055.124305:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792055.124306:0:22692:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788792055.124309:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788792055.124312:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792055.124313:0:22692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788792055.124316:0:22692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c617fa8f000 00000020:00000080:0.0:1788792055.124318:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788792055.124336:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788792055.124339:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792055.124340:0:22692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788792055.124342:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788792055.124345:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792055.124346:0:22692:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788792055.124357:0:22692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c617fa8f000 00000020:00000080:0.0:1788792055.124359:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788792055.124402:0:22692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a140336d-9a80-41e1-97b0-93600c05b204:22692:1875683785811584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788792055.124445:0:22692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792055.124473:0:22692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c614559aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788792055.126083:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785811584 00000100:00100000:3.0:1788792055.126095:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785811584 00000100:00100000:3.0:1788792055.126273:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788792055.126283:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+11:22692:x1875683785811584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788792055.126436:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+11:22692:x1875683785811584:12345-0@lo:502:llog_process_th.0 Request processed in 154us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792055.126444:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788792055.126695:0:22692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a140336d-9a80-41e1-97b0-93600c05b204:22692:1875683785811584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788792055.126730:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788792055.126737:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792055.126739:0:22692:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788792055.126743:0:22692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788792055.126988:0:22643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788792055.127013:0:22643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788792055.127037:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3627b expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792055.127048:0:22643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3627b expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788792055.127215:0:22643:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788792055.127219:0:22643:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c617fa8f000 10000000:01000000:3.0:1788792055.127222:0:22643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c617fa8f000 10000000:01000000:3.0:1788792055.127226:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788792055.127233:0:22643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c617fa8f000 from 1 10000000:01000000:3.0:1788792055.127235:0:22643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788792055.127269:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6181362e00/0x4d37c11031f36282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792055.127278:0:22643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c6181362e00/0x4d37c11031f36282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792055.127296:0:22643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c6181362e00/0x4d37c11031f36282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792055.127317:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785811712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788792055.127361:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792055.127394:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6175e14180 going to sleep for 11 seconds 00000100:00100000:3.0:1788792055.127413:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785811712 00000100:00100000:3.0:1788792055.127418:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785811712 00000100:00100000:3.0:1788792055.127443:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788792055.127449:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+11:22643:x1875683785811712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788792055.127459:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792055.127471:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6181363800/0x4d37c11031f36289 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f36282 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792055.127492:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6181363800/0x4d37c11031f36289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f36282 expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792055.127501:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6181363800/0x4d37c11031f36289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36282 expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792055.127509:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6181363800, rc 0) 00000100:00100000:3.0:1788792055.127544:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:22643:x1875683785811712:12345-0@lo:101:mount.lustre.0 Request processed in 95us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792055.127550:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788792055.127590:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785811712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788792055.127602:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c6181362e00/0x4d37c11031f36282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36289 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792055.127618:0:22643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c6181362e00/0x4d37c11031f36282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f36289 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792055.128694:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785811840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788792055.128753:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792055.128783:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6175e14180 going to sleep for 11 seconds 00000100:00100000:3.0:1788792055.128805:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785811840 00000100:00100000:3.0:1788792055.128810:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785811840 00000100:00100000:3.0:1788792055.128838:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788792055.128846:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:22643:x1875683785811840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788792055.128992:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:22643:x1875683785811840:12345-0@lo:501:mount.lustre.0 Request processed in 146us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792055.129002:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788792055.129046:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785811840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788792055.129093:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785811968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788792055.129131:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792055.129148:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6175e14180 going to sleep for 11 seconds 00000100:00100000:3.0:1788792055.129162:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785811968 00000100:00100000:3.0:1788792055.129166:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785811968 00000100:00100000:3.0:1788792055.129184:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788792055.129190:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:22643:x1875683785811968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788792055.129267:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:22643:x1875683785811968:12345-0@lo:503:mount.lustre.0 Request processed in 76us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792055.129273:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788792055.129317:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785811968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788792055.143673:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a140336d-9a80-41e1-97b0-93600c05b204:22695:1875683785812096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788792055.143779:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792055.143835:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785812096 00000100:00100000:3.0:1788792055.143843:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785812096 00000100:00100000:3.0:1788792055.143912:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788792055.143923:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:22695:x1875683785812096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788792055.144152:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:22695:x1875683785812096:12345-0@lo:502:llog_process_th.0 Request processed in 151us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792055.144163:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788792055.144231:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6175e14180 going to sleep for 11 seconds 00000100:00100000:3.0:1788792055.144258:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a140336d-9a80-41e1-97b0-93600c05b204:22695:1875683785812096:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788792055.144337:0:22695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788792055.144357:0:22695:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8c6043f619b8) 00000020:00000080:3.0:1788792055.144382:0:22695:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788792055.144476:0:22695:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c617fa8f000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788792055.144482:0:22695:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c617fa8f000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788792055.144484:0:22695:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c617fa8f000 4 00010000:00080000:3.0:1788792055.144525:0:22695:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c6175f25000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788792055.149983:0:22695:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788792055.152471:0:22695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788792055.152526:0:22695:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788792055.152541:0:22695:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4d37c11031f36297 00000100:00080000:3.0:1788792055.152554:0:22695:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788792055.152562:0:22695:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c6175f25000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788792055.152606:0:22695:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6151f4f800 x1875683785812224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788792055.152671:0:22695:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788792055.156392:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875683785812224:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788792055.156502:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792055.156607:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785812224 00000100:00100000:0.0:1788792055.156619:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785812224 00000100:00100000:0.0:1788792055.156672:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788792055.156681:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875683785812224:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788792055.156743:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875683785812224:12345-0@lo:38:llog_process_th.0 Request processed in 62us (241us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788792055.156751:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788792055.156803:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788792055.156813:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6175f25000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788792055.156817:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788792055.156820:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875683785812224:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788792055.164793:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a140336d-9a80-41e1-97b0-93600c05b204:22695:1875683785812352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788792055.164894:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792055.164937:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6175e14cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788792055.167190:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785812352 00000100:00100000:3.0:1788792055.167208:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785812352 00000100:00100000:3.0:1788792055.167272:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788792055.167284:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+12:22695:x1875683785812352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788792055.167475:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+12:22695:x1875683785812352:12345-0@lo:502:llog_process_th.0 Request processed in 193us (2580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792055.167484:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788792055.167562:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a140336d-9a80-41e1-97b0-93600c05b204:22695:1875683785812352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788792055.167646:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a140336d-9a80-41e1-97b0-93600c05b204:22695:1875683785812480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788792055.167689:0:22695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792055.167715:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785812480 00000100:00100000:3.0:1788792055.167719:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785812480 00000100:00100000:3.0:1788792055.167740:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788792055.167746:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+12:22695:x1875683785812480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788792055.167811:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+12:22695:x1875683785812480:12345-0@lo:502:llog_process_th.0 Request processed in 60us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792055.167818:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788792055.167856:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6175e14cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788792055.167868:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a140336d-9a80-41e1-97b0-93600c05b204:22695:1875683785812480:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788792055.167918:0:22695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788792055.172817:0:22643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788792055.172859:0:22643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788792055.172891:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6181362e00/0x4d37c11031f36282 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36289 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792055.172904:0:22643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6181362e00/0x4d37c11031f36282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36289 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788792055.172973:0:22643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788792055.172976:0:22643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788792055.172977:0:22643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788792055.172978:0:22643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788792055.172979:0:22643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788792055.172980:0:22643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788792055.172981:0:22643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788792055.172983:0:22643:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788792055.172985:0:22643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788792055.172986:0:22643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788792055.172990:0:22643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788792055.172992:0:22643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788792055.172993:0:22643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788792055.172994:0:22643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788792055.172995:0:22643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788792055.172996:0:22643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788792055.172997:0:22643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788792055.172998:0:22643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788792055.172999:0:22643:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788792055.173000:0:22643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788792055.173001:0:22643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788792055.173029:0:22643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788792055.173053:0:22643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785812608:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788792055.173139:0:22643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792055.173186:0:22643:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c614683a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788792055.174270:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785812608 00000100:00100000:1.0:1788792055.174281:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785812608 00000100:00100000:1.0:1788792055.174340:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788792055.174350:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:22643:x1875683785812608:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788792055.174384:0:22659:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788792055.174400:0:22659:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788792055.182830:0:22659:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788792055.182857:0:22659:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788792055.184435:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:22643:x1875683785812608:12345-0@lo:253:mount.lustre.0 Request processed in 10062us (11271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792055.184450:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788792055.184519:0:22643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:22643:1875683785812608:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788792055.184535:0:22643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788792055.184538:0:22643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788792055.184540:0:22643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788792055.184541:0:22643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788792055.184542:0:22643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788792055.184544:0:22643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788792055.184545:0:22643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788792055.184547:0:22643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788792055.184548:0:22643:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788792055.184550:0:22643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788792055.184551:0:22643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788792055.184564:0:22643:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788792055.194457:0:22680:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788792055.194467:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788792055.194495:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792055.194514:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c6181363400/0x4d37c11031f3626d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36266 expref: 11 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792055.194521:0:22680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792055.194570:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c6181363400/0x4d37c11031f3626d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4d37c11031f36266 expref: 11 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792055.194605:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c6181363400/0x4d37c11031f3626d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4d37c11031f36266 expref: 11 pid: 22659 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792055.194635:0:22680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875683785812736:0@lo:104: 00000100:00100000:3.0:1788792055.194702:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792055.194752:0:22680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6043076d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788792055.195202:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785812736 00000100:00100000:2.0:1788792055.195211:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785812736 00000100:00100000:2.0:1788792055.195256:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788792055.195265:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a140336d-9a80-41e1-97b0-93600c05b204+3:22680:x1875683785812736:12345-0@lo:104: 00010000:00010000:2.0:1788792055.195279:0:22647:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f3626d expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195341:0:22647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788792055.195347:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a140336d-9a80-41e1-97b0-93600c05b204+3:22680:x1875683785812736:12345-0@lo:104: Request processed in 84us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792055.195355:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788792055.195397:0:22680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875683785812736:0@lo:104: 00010000:00010000:2.0:1788792055.195420:0:22680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195435:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788792055.195440:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f3626d expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195447:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b952c00 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:2.0:1788792055.195459:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4d37c11031f3626d expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195467:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4d37c11031f3626d expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788792055.195475:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4d37c11031f3626d expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788792055.195481:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788792055.195520:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3626d expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195527:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788792055.195546:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3626d expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195553:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c617b952c00/0x4d37c11031f36266 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3626d expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195568:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792055.195570:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792055.195572:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788792055.195593:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788792055.195603:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a140336d-9a80-41e1-97b0-93600c05b204:3642:1875683785812864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788792055.195649:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792055.195695:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785812864 00000100:00100000:2.0:1788792055.195699:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785812864 00010000:00010000:2.0:1788792055.195715:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c6181363400/0x4d37c11031f3626d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f36266 expref: 12 pid: 22659 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792055.195747:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788792055.195753:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043709180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a140336d-9a80-41e1-97b0-93600c05b204+12:3642:x1875683785812864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788792055.195764:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788792055.195769:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c6181363400/0x4d37c11031f3626d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f36266 expref: 12 pid: 22659 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195778:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c6181363400/0x4d37c11031f3626d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4d37c11031f36266 expref: 12 pid: 22659 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195791:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6181363400/0x4d37c11031f3626d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4d37c11031f36266 expref: 12 pid: 22659 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195804:0:22649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195811:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788792055.195822:0:22649:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001356566s 00010000:00010000:2.0:1788792055.195826:0:22649:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195834:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195840:0:22649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195846:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195859:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6181362c00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788792055.195862:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195889:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195902:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195912:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788792055.195940:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043709180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a140336d-9a80-41e1-97b0-93600c05b204+11:3642:x1875683785812864:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792055.195947:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788792055.195969:0:22680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195976:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792055.195982:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6181362c00/0x4d37c11031f3629e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792055.196008:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a140336d-9a80-41e1-97b0-93600c05b204:3642:1875683785812864:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788792055.224403:0:22643:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:1.0:1788792055.224729:0:22643:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788792055.225134:0:22705:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788792055.225452:0:22643:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788792055.225755:0:22705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788792055.227816:0:22705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788792055.227946:0:22705:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:0.0:1788792055.228405:0:22706:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8c6043dc8e00 x1875683785812992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792055.228418:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00000040:01000000:1.0:1788792055.229024:0:22643:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788792055.229063:0:22643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788792055.229498:0:22643:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788792055.229507:0:22643:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788792055.229544:0:22643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788792055.230543:0:22643:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788792055.231137:0:22643:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788792055.231170:0:22643:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000020:00080000:3.0:1788792055.232125:0:22704:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:3.0:1788792055.232134:0:22704:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:00080000:1.0:1788792055.232586:0:22643:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788792055.233708:0:22643:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1788792055.240239:0:22643:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788792055.242064:0:22643:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788792055.242183:0:22643:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9d26017e3988 00100000:10000000:2.0:1788792055.242193:0:22643:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788792055.243749:0:22643:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788792055.243765:0:22643:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788792055.243784:0:22643:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788792055.243806:0:22643:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788792055.255718:0:22643:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788792055.255950:0:22643:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788792055.836730:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788792056.215074:0:22661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788792056.215083:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c617fa8f000 from 11 10000000:01000000:0.0:1788792056.215089:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788792056.215133:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792056.215145:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792056.215157:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792056.215182:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785813120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788792056.215251:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792056.215295:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788792056.215427:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785813120 00000100:00100000:3.0:1788792056.215435:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785813120 00000100:00100000:3.0:1788792056.215494:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788792056.215505:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+11:22661:x1875683785813120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788792056.215518:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792056.215533:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6181362000/0x4d37c11031f362ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f362a5 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792056.215564:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6181362000/0x4d37c11031f362ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f362a5 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792056.215574:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6181362000/0x4d37c11031f362ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f362a5 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792056.215582:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6181362000, rc 0) 00000100:00100000:3.0:1788792056.215635:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+12:22661:x1875683785813120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792056.215642:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788792056.215689:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785813120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788792056.215703:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f362ac expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792056.215712:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f362ac expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792056.215762:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785813248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788792056.215792:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792056.215806:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c614559aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788792056.215818:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785813248 00000100:00100000:3.0:1788792056.215822:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785813248 00000100:00100000:3.0:1788792056.215843:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788792056.215849:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:22661:x1875683785813248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788792056.215862:0:22659:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788792056.215909:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788792056.215918:0:22659:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788792056.215996:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:22661:x1875683785813248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792056.216003:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788792056.216033:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785813248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788792056.216077:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788792056.216086:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f362ac expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792056.216094:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f362ac expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788792056.223587:0:22700:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788792056.223597:0:22700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788792056.225798:0:22700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788792056.225809:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788792056.282541:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:1.0:1788792056.858108:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788792057.240502:0:22700:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788792057.240512:0:22700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788792057.240653:0:22700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1788792057.240697:0:22700:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788792057.240845:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:1.0:1788792057.302016:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:2.0:1788792057.885606:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788792058.327098:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:3.0:1788792058.903102:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788792059.353129:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:3.0:1788792059.928464:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788792060.147169:0:22949:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788792060.377353:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00000100:00080000:0.0:1788792060.444375:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788792060.444382:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788792060.444386:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c61813c7000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788792060.444394:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 698 00000100:00080000:0.0:1788792060.444400:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788792060.444408:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c61813c7000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788792060.444431:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043dc9c00 x1875683785813504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788792060.444448:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788792060.444452:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788792060.444455:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788792060.444458:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788792060.444467:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788792060.444470:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788792060.444472:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c6175f25000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788792060.444477:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c6175f25000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788792060.444489:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043dcb480 x1875683785813632/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788792060.444646:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788792060.444665:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785813376:0@lo:400:kworker.0 00000100:00100000:0.0:1788792060.444743:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792060.444804:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785813504:0@lo:38:kworker.0 00000100:00100000:0.0:1788792060.444836:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792060.444852:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875683785813632:0@lo:38:kworker.0 00000100:00100000:0.0:1788792060.444896:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792060.444938:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785813632 00000100:00100000:0.0:1788792060.444947:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785813632 00000100:00100000:0.0:1788792060.444976:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788792060.444983:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875683785813632:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788792060.445023:0:22666:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:0.0:1788792060.445060:0:22666:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4d37c11031f362b3 00000004:00100000:0.0:1788792060.445076:0:22666:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788792060.445192:0:22666:0:(import.c:65:import_set_state_nolock()) ffff8c617f9bf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788792060.445253:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875683785813632:12345-0@lo:38:kworker.0 Request processed in 269us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792060.445261:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788792060.445504:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c6043dcb480 x1875683785813632/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788792070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788792060.445521:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788792060.445545:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788792060.445551:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788792060.445554:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6175f25000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788792060.445561:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875683785813632:0@lo:38:kworker.0 00000100:00100000:3.0:1788792060.447186:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785813376 00000100:00100000:3.0:1788792060.447201:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785813376 00000100:00100000:3.0:1788792060.447268:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788792060.447278:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:3641:x1875683785813376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792060.447363:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:3641:x1875683785813376:12345-0@lo:400:kworker.0 Request processed in 87us (2619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792060.447370:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788792060.447415:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785813504 00000100:00100000:3.0:1788792060.447420:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785813504 00000100:00100000:3.0:1788792060.447448:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788792060.447453:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875683785813504:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788792060.447482:0:22670:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788792060.447526:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875683785813504:12345-0@lo:38:kworker.0 Request processed in 72us (2689us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788792060.447556:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788792060.447597:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785813376:0@lo:400:kworker.0 00000100:00080000:3.0:1788792060.447638:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c61813c7000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788792060.447643:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788792060.447646:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785813504:0@lo:38:kworker.0 00010000:00010000:3.0:1788792060.950219:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788792061.327919:0:23001:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788792061.328319:0:23001:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788792061.416074:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:3.0:1788792061.977898:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788792062.347621:0:23051:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788792062.348530:0:23051:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788792062.422183:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:3.0:1788792062.999723:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788792063.459920:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:0.0:1788792064.030772:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788792064.470151:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:1.0:1788792065.056174:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788792065.496466:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00000100:00080000:1.0:1788792065.558405:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788792065.558413:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788792065.558418:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c61813c7000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788792065.558429:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 703 00000100:00080000:1.0:1788792065.558436:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788792065.558453:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c61813c7000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792065.558486:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d14700 x1875683785813888/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788792065.558513:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792065.558518:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788792065.558522:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792065.558524:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788792065.558618:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875683785814016:0@lo:400:kworker.0 00000100:00100000:2.0:1788792065.558719:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792065.558814:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788792065.558820:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a140336d-9a80-41e1-97b0-93600c05b204:3644:1875683785813760:0@lo:400:kworker.0 00000100:00100000:2.0:1788792065.558854:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792065.558936:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785813760 00000100:00100000:2.0:1788792065.558947:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785813760 00000100:00100000:2.0:1788792065.559010:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788792065.559021:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+12:3644:x1875683785813760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792065.559088:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+12:3644:x1875683785813760:12345-0@lo:400:kworker.0 Request processed in 69us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792065.559096:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788792065.559146:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a140336d-9a80-41e1-97b0-93600c05b204:3644:1875683785813760:0@lo:400:kworker.0 00000100:00100000:1.0:1788792065.559380:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785814016 00000100:00100000:1.0:1788792065.559385:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785814016 00000100:00100000:1.0:1788792065.559450:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788792065.559477:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604370b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875683785814016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792065.559520:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604370b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875683785814016:12345-0@lo:400:kworker.0 Request processed in 46us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792065.559527:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788792065.559646:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788792055/real 1788792055] req@ffff8c604370ad80 x1875683785810560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792065 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792065.559666:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c604370ad80 x1875683785810560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792065 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792065.559677:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788792055/real 1788792055] req@ffff8c6043dca300 x1875683785810432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792065 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792065.559688:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c6043dca300 x1875683785810432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792065 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792065.559702:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785813888:0@lo:38:kworker.0 00000100:00100000:0.0:1788792065.559736:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788792065.559769:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6043732000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788792065.559784:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788792065.559788:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785810560:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788792065.559794:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6174caa000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788792065.559799:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788792065.559802:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785810432:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788792065.559905:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785813888 00000100:00100000:1.0:1788792065.559910:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785813888 00000100:00100000:1.0:1788792065.559934:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788792065.559939:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875683785813888:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788792065.559963:0:22670:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788792065.560004:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875683785813888:12345-0@lo:38:kworker.0 Request processed in 64us (267us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788792065.560011:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788792065.560054:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c61813c7000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788792065.560058:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788792065.560061:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785813888:0@lo:38:kworker.0 00000100:00080000:1.0:1788792065.560079:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792065.560083:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788792065.560085:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c6174caa000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788792065.560089:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 698 00000100:00080000:1.0:1788792065.560092:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788792065.560097:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c6174caa000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792065.560120:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d14700 x1875683785814144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788792065.560138:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792065.560141:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788792065.560151:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c6043732000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788792065.560155:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 698 00000100:00080000:1.0:1788792065.560159:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788792065.560164:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c6043732000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792065.560177:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d17100 x1875683785814272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788792065.560198:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785814144:0@lo:8:kworker.0 00000400:00000100:1.0:1788792065.560224:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683785814144 offset 0 length 520: 4 00000100:00100000:1.0:1788792065.560242:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785814272:0@lo:8:kworker.0 00000400:00000100:1.0:1788792065.560262:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683785814272 offset 0 length 520: 4 00010000:00080000:2.0:1788792065.561597:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c6043d14a80 x1875683785814016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788792065.561615:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875683785814016:0@lo:400:kworker.0 00010000:00010000:0.0:1788792066.070089:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788792066.518184:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:1.0:1788792067.099833:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788792067.481810:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788792067.542041:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:1.0:1788792068.120344:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788792068.568441:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:3.0:1788792069.146512:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788792069.591212:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:1.0:1788792070.166140:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788792070.279402:0:23396:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788792070.279407:0:23396:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788792070.279408:0:23396:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788792070.279524:0:23396:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c617f976000 00000020:01000004:2.0:1788792070.279539:0:23396:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788792070.279558:0:23396:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788792070.279574:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8c6043530000) 00000020:00000080:2.0:1788792070.279590:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788792070.419575:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.423989:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788792070.424980:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788792070.425342:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788792070.425616:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788792070.425939:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788792070.426629:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788792070.428331:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788792070.428908:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788792070.429939:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788792070.430291:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788792070.431215:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788792070.436060:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788792070.436597:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788792070.440037:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.440498:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.440851:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.441142:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.442551:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.445611:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.446125:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.446560:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.449590:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.450124:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.450392:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.451144:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.451823:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.452144:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.452408:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.452653:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.452995:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.453240:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.453741:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.454137:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.454408:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.454654:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.455624:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.457902:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.458325:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.458637:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.458948:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.459202:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.459448:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.459960:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788792070.460230:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788792070.460443:0:23396:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00080000:01000000:2.0:1788792070.461687:0:23396:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788792070.464036:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788792070.464052:0:23396:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788792070.464071:0:23396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4d37c11031f362c1 00000020:01000004:2.0:1788792070.464082:0:23396:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788792070.464106:0:23396:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788792070.464126:0:23396:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788792070.464133:0:23396:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788792070.464167:0:23396:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788792070.464172:0:23396:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788792070.487087:0:23396:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788792070.487142:0:23396:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.120@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788792070.487149:0:23396:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788792070.487151:0:23396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788792070.487153:0:23396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788792070.487154:0:23396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788792070.487155:0:23396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788792070.487156:0:23396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788792070.487164:0:23396:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788792070.487167:0:23396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788792070.487168:0:23396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788792070.487173:0:23396:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788792070.487175:0:23396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788792070.487176:0:23396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788792070.487177:0:23396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788792070.487178:0:23396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788792070.487179:0:23396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788792070.487180:0:23396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788792070.487181:0:23396:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788792070.487182:0:23396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788792070.487183:0:23396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788792070.487215:0:23396:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788792070.487239:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785814400:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788792070.487343:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.487465:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788792070.491103:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785814400 00000100:00100000:3.0:1788792070.491124:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785814400 00000100:00100000:3.0:1788792070.491263:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788792070.491275:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:23396:x1875683785814400:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788792070.491317:0:22659:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788792070.491321:0:22659:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788792070.491330:0:22659:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788792070.492682:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:23396:x1875683785814400:12345-0@lo:253:mount.lustre.0 Request processed in 1405us (5334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792070.492767:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788792070.492938:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785814400:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788792070.492955:0:23396:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788792070.492958:0:23396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788792070.492960:0:23396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788792070.492961:0:23396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788792070.492962:0:23396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788792070.492964:0:23396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788792070.492965:0:23396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788792070.492966:0:23396:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788792070.492968:0:23396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788792070.492970:0:23396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788792070.492995:0:23396:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c617f976000 from lustre-MDT0001 10000000:01000000:0.0:1788792070.493025:0:23396:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788792070.493027:0:23396:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788792070.493034:0:23396:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c604218b370 local copy 00010000:00010000:0.0:1788792070.493045:0:23396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361be expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792070.493156:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785814528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788792070.493210:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.497470:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788792070.501414:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785814528 00000100:00100000:3.0:1788792070.501436:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785814528 00000100:00100000:3.0:1788792070.501516:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788792070.501528:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:23396:x1875683785814528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788792070.501692:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:23396:x1875683785814528:12345-0@lo:501:mount.lustre.0 Request processed in 165us (8479us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788792070.501700:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788792070.501867:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785814528:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788792070.501935:0:23396:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788792070.501963:0:23396:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788792070.501971:0:23396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361be expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.501981:0:23396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361be expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792070.502015:0:23396:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c617f976000 10000000:01000000:0.0:1788792070.502020:0:23396:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788792070.502024:0:23396:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8c604218b370 10000000:01000000:0.0:1788792070.502027:0:23396:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788792070.502031:0:23396:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8c604218b370 from 1 10000000:01000000:0.0:1788792070.502034:0:23396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788792070.502066:0:23396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b952800/0x4d37c11031f362c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.502075:0:23396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c617b952800/0x4d37c11031f362c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.502084:0:23396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c617b952800/0x4d37c11031f362c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792070.502104:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785814656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788792070.502142:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.502184:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788792070.502317:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785814656 00000100:00100000:3.0:1788792070.502322:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785814656 00000100:00100000:3.0:1788792070.502346:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788792070.502364:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+12:23396:x1875683785814656:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788792070.502374:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792070.502389:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6181362a00/0x4d37c11031f362cf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f362c8 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.502411:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6181362a00/0x4d37c11031f362cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f362c8 expref: 13 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.502422:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6181362a00/0x4d37c11031f362cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f362c8 expref: 13 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.502430:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6181362a00, rc 0) 00000100:00100000:3.0:1788792070.502472:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+13:23396:x1875683785814656:12345-0@lo:101:mount.lustre.0 Request processed in 119us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792070.502478:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788792070.502549:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785814656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788792070.502562:0:23396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c617b952800/0x4d37c11031f362c8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f362cf expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.502572:0:23396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c617b952800/0x4d37c11031f362c8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f362cf expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792070.502588:0:23396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788792070.502605:0:23396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b952800/0x4d37c11031f362c8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f362cf expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.502612:0:23396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c617b952800/0x4d37c11031f362c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f362cf expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792070.502619:0:23396:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c617f976000 10000000:01000000:0.0:1788792070.502623:0:23396:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788792070.502626:0:23396:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8c617f976000 from 1 10000000:01000000:0.0:1788792070.502628:0:23396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788792070.502642:0:23396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b952600/0x4d37c11031f362d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.502648:0:23396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c617b952600/0x4d37c11031f362d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.502654:0:23396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c617b952600/0x4d37c11031f362d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792070.502664:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785814784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788792070.502687:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.502709:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788792070.502759:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785814784 00000100:00100000:3.0:1788792070.502764:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785814784 00000100:00100000:3.0:1788792070.502781:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788792070.502786:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+13:23396:x1875683785814784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788792070.502793:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792070.502813:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6181362600/0x4d37c11031f362dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f362d6 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.502826:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6181362600/0x4d37c11031f362dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f362d6 expref: 14 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.502834:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6181362600/0x4d37c11031f362dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f362d6 expref: 14 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.502846:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6181362600, rc 0) 00000100:00100000:3.0:1788792070.502904:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+14:23396:x1875683785814784:12345-0@lo:101:mount.lustre.0 Request processed in 117us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792070.502911:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788792070.503038:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785814784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788792070.503048:0:23396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c617b952600/0x4d37c11031f362d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f362dd expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.503056:0:23396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c617b952600/0x4d37c11031f362d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f362dd expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792070.503067:0:23396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788792070.503079:0:23396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b952600/0x4d37c11031f362d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f362dd expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.503086:0:23396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c617b952600/0x4d37c11031f362d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f362dd expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792070.503092:0:23396:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788792070.503095:0:23396:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788792070.503099:0:23396:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c617f976000 10000000:01000000:0.0:1788792070.503101:0:23396:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788792070.503104:0:23396:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788792070.503106:0:23396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788792070.503117:0:23396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b952000/0x4d37c11031f362e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.503123:0:23396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c617b952000/0x4d37c11031f362e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.503130:0:23396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c617b952000/0x4d37c11031f362e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792070.503150:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785814912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788792070.503175:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.503194:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788792070.503244:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785814912 00000100:00100000:3.0:1788792070.503248:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785814912 00000100:00100000:3.0:1788792070.503267:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788792070.503272:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+14:23396:x1875683785814912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788792070.503278:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792070.503287:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6181363a00/0x4d37c11031f362eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f362e4 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.503299:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6181363a00/0x4d37c11031f362eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f362e4 expref: 15 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.503307:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6181363a00/0x4d37c11031f362eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f362e4 expref: 15 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.503314:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6181363a00, rc 0) 00000100:00100000:3.0:1788792070.503393:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+15:23396:x1875683785814912:12345-0@lo:101:mount.lustre.0 Request processed in 121us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792070.503400:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788792070.507260:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785814912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788792070.507291:0:23396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c617b952000/0x4d37c11031f362e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f362eb expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.507303:0:23396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c617b952000/0x4d37c11031f362e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f362eb expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788792070.509200:0:23396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1788792070.509745:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788792070.521077:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788792070.521143:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1788792070.521156:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1788792070.521302:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1788792070.521317:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1788792070.521328:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1788792070.521340:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1788792070.521362:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1788792070.521379:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1788792070.521396:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1788792070.521408:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1788792070.521419:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1788792070.521430:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1788792070.521441:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1788792070.521453:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1788792070.521464:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1788792070.521476:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1788792070.521501:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1788792070.521514:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1788792070.521528:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1788792070.521540:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1788792070.521552:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1788792070.521564:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1788792070.521577:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1788792070.521592:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1788792070.521604:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1788792070.521617:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1788792070.521629:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1788792070.521642:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1788792070.521655:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1788792070.521667:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1788792070.521679:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1788792070.521690:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1788792070.521701:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1788792070.521712:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1788792070.521725:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1788792070.521736:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1788792070.521747:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1788792070.521758:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1788792070.521769:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1788792070.521780:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1788792070.521791:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1788792070.521802:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1788792070.521813:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1788792070.521837:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1788792070.521842:0:23396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1788792070.523129:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785815040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788792070.523441:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.523532:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788792070.526848:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785815040 00000100:00100000:3.0:1788792070.526868:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785815040 00000100:00100000:3.0:1788792070.526984:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788792070.526998:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+15:23396:x1875683785815040:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788792070.527244:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+15:23396:x1875683785815040:12345-0@lo:501:mount.lustre.0 Request processed in 249us (3803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792070.527269:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788792070.527635:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785815040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788792070.527689:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785815168:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788792070.527737:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.527786:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788792070.527909:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785815168 00000100:00100000:2.0:1788792070.527916:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785815168 00000100:00100000:2.0:1788792070.527956:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788792070.527965:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+15:23396:x1875683785815168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788792070.528942:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+15:23396:x1875683785815168:12345-0@lo:503:mount.lustre.0 Request processed in 973us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792070.528952:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788792070.529117:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785815168:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788792070.529701:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788792070.529776:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785815296:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792070.530053:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.530086:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788792070.530176:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785815296 00000100:00100000:1.0:1788792070.530183:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785815296 00000100:00100000:1.0:1788792070.530228:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788792070.530237:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+15:23396:x1875683785815296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788792070.530962:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+15:23396:x1875683785815296:12345-0@lo:502:mount.lustre.0 Request processed in 722us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792070.530972:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788792070.531100:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785815296:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788792070.531476:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788792070.531510:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1788792070.531527:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1788792070.531542:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1788792070.531557:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1788792070.531573:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1788792070.531586:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1788792070.531596:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1788792070.531607:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1788792070.531619:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1788792070.531633:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1788792070.531647:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1788792070.531661:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1788792070.531675:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1788792070.531688:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1788792070.531698:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1788792070.531708:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1788792070.531718:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1788792070.531737:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1788792070.531748:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1788792070.531763:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1788792070.531777:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1788792070.531789:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1788792070.532307:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1788792070.532337:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1788792070.532349:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1788792070.532375:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1788792070.532387:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1788792070.532400:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1788792070.532411:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1788792070.532423:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1788792070.532434:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1788792070.532445:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1788792070.532457:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1788792070.532468:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1788792070.532480:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1788792070.532491:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1788792070.532502:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1788792070.532514:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1788792070.532525:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1788792070.532535:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1788792070.532546:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1788792070.532559:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1788792070.532574:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1788792070.532612:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785815424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792070.532679:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.532729:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788792070.534152:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785815424 00000100:00100000:3.0:1788792070.534178:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785815424 00000100:00100000:3.0:1788792070.534240:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788792070.534250:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+15:23396:x1875683785815424:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788792070.534428:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+15:23396:x1875683785815424:12345-0@lo:502:mount.lustre.0 Request processed in 177us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792070.534437:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788792070.535006:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785815424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788792070.535094:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1788792070.535107:0:23396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788792070.538388:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788792070.538405:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788792070.538407:0:23400:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788792070.538413:0:23400:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788792070.538416:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788792070.538432:0:23400:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8c6043533370) 00000020:00000080:2.0:1788792070.538457:0:23400:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788792070.538462:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788792070.538544:0:23400:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788792070.538552:0:23400:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4d37c11031f362f9 00000020:00000080:2.0:1788792070.538784:0:23400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788792070.538789:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788792070.538792:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788792070.538794:0:23400:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788792070.538796:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788792070.542237:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788792070.542263:0:23400:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788792070.542282:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788792070.542299:0:23400:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8c60435319b8) 00000020:00000080:2.0:1788792070.542328:0:23400:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788792070.542332:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788792070.542334:0:23400:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788792070.542337:0:23400:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788792070.542345:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788792070.542454:0:23400:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c617f976000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788792070.542466:0:23400:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8c6043534d28) 00000020:00000080:2.0:1788792070.542476:0:23400:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788792070.542538:0:23400:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788792070.542544:0:23400:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4d37c11031f3630e 00000020:00000080:2.0:1788792070.542698:0:23400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788792070.542705:0:23400:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788792070.542709:0:23400:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4d37c11031f36315 00080000:01000000:2.0:1788792070.542715:0:23400:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788792070.542719:0:23400:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4d37c11031f3631c 00000100:00100000:1.0:1788792070.614030:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:3.0:1788792070.631756:0:23400:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788792070.632585:0:23400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1788792070.639547:0:23400:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788792070.640604:0:23400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788792070.640617:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788792070.640623:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792070.640625:0:23400:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788792070.640628:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788792070.640634:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792070.640636:0:23400:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788792070.640638:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788792070.640643:0:23400:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:00000080:3.0:1788792070.640669:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788792070.640685:0:23400:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8c6043f63370) 00000020:00000080:3.0:1788792070.640710:0:23400:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788792070.640715:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788792070.640774:0:23400:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788792070.640781:0:23400:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788792070.640788:0:23400:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4d37c11031f3632a 00010000:00080000:3.0:1788792070.640995:0:23400:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c617c333800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.120@tcp at head 00010000:00010000:0.0:1788792070.655224:0:23400:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788792070.656304:0:23400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788792070.656325:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788792070.656377:0:23400:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788792070.656403:0:23400:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4d37c11031f36331 00000100:00080000:3.0:1788792070.656416:0:23400:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788792070.656422:0:23400:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c617c333800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788792070.656469:0:23400:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6151f4f100 x1875683785815552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788792070.656498:0:23400:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788792070.656554:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788792070.656559:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792070.656561:0:23400:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788792070.656564:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788792070.656567:0:23400:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788792070.656569:0:23400:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788792070.656570:0:23400:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788792070.656572:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788792070.656574:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792070.656576:0:23400:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788792070.656578:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788792070.656582:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792070.656583:0:23400:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788792070.656586:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788792070.656615:0:23400:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788792070.656627:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788792070.656629:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792070.656630:0:23400:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788792070.656633:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788792070.656635:0:23400:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788792070.656636:0:23400:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788792070.656637:0:23400:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788792070.656639:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788792070.656641:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792070.656647:0:23400:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788792070.656651:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788792070.656654:0:23400:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788792070.656657:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792070.656658:0:23400:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788792070.656661:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788792070.656665:0:23400:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:3.0:1788792070.656691:0:23400:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788792070.656693:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788792070.656706:0:23400:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8c6043f60000) 00000020:00000080:3.0:1788792070.656717:0:23400:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788792070.656721:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788792070.656790:0:23400:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00000100:00100000:1.0:1788792070.657087:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785815552:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788792070.657181:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792070.657244:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785815552 00000100:00100000:1.0:1788792070.657252:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785815552 00000100:00100000:1.0:1788792070.657285:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788792070.657292:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875683785815552:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788792070.657317:0:22670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:1.0:1788792070.657347:0:22670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4d37c11031f3633f 00000004:00100000:1.0:1788792070.657374:0:22670:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788792070.657381:0:22670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00080000:01000000:3.0:1788792070.657543:0:23400:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788792070.657551:0:23400:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4d37c11031f36346 00010000:00080000:3.0:1788792070.657594:0:23400:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c617c331000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788792070.657952:0:23400:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:0.0:1788792070.658396:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788792070.658410:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788792070.658414:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c61813c7000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788792070.658420:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 708 00000100:00080000:0.0:1788792070.658426:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788792070.658430:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c61813c7000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788792070.658460:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043dc9880 x1875683785815680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788792070.658486:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788792070.658489:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788792070.658492:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788792070.658495:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788792070.658535:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785815808:0@lo:400:kworker.0 00000100:00100000:0.0:1788792070.658585:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.658636:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785815808 00000100:00100000:0.0:1788792070.658643:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785815808 00000100:00100000:0.0:1788792070.658687:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788792070.658697:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785815808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792070.658747:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785815808:12345-0@lo:400:kworker.0 Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792070.658756:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788792070.658813:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c6043dca680 x1875683785815808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792070.658827:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785815808:0@lo:400:kworker.0 00000100:00100000:1.0:1788792070.659020:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785815680:0@lo:38:kworker.0 00000100:00100000:1.0:1788792070.659053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.661525:0:22669:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788792070.661559:0:22669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:01000000:0.0:1788792070.662314:0:23400:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788792070.662760:0:23400:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1788792070.671002:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785815680 00000100:00100000:3.0:1788792070.671018:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785815680 00000100:00100000:1.0:1788792070.671287:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788792070.671296:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875683785815680:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788792070.671406:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875683785815680:12345-0@lo:38:kworker.0 Request processed in 110us (12351us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788792070.671413:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788792070.671941:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788792070.671951:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c61813c7000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788792070.671956:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788792070.671959:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785815680:0@lo:38:kworker.0 00000040:00080000:0.0:1788792070.672309:0:23400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1788792070.674090:0:22670:0:(import.c:65:import_set_state_nolock()) ffff8c617f9be800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788792070.674207:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1875683785815552:12345-0@lo:38:llog_process_th.0 Request processed in 16911us (17024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792070.674218:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788792070.674342:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788792070.674363:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788792070.674373:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788792070.674380:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788792070.674384:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c617c333800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788792070.674406:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785815552:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788792070.674544:0:23400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788792070.674732:0:23400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1788792070.675165:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788792070.675181:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785815936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788792070.675240:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792070.675364:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785815936 00000100:00100000:3.0:1788792070.675372:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785815936 00000100:00100000:3.0:1788792070.675423:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788792070.675432:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875683785815936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788792070.675465:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788792070.675519:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875683785815936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792070.675526:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:1.0:1788792070.675667:0:23406:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788792070.675672:0:23406:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1788792070.675751:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785815936:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1788792070.678706:0:23400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788792070.678724:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788792070.678780:0:23400:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788792070.678816:0:23400:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4d37c11031f3634d 00000100:00080000:0.0:1788792070.678827:0:23400:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788792070.678833:0:23400:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c617c331000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788792070.678949:0:23400:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043dca680 x1875683785816064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788792070.679011:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785816064:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788792070.679078:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683785816064 offset 0 length 520: 4 00000100:00080000:0.0:1788792070.679136:0:23400:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788792070.679216:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788792070.679220:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792070.679222:0:23400:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788792070.679226:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788792070.679228:0:23400:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788792070.679230:0:23400:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788792070.679231:0:23400:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788792070.679233:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788792070.679235:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792070.679244:0:23400:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788792070.679248:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788792070.679252:0:23400:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788792070.679256:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792070.679257:0:23400:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788792070.679259:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788792070.679263:0:23400:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:0.0:1788792070.679286:0:23400:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788792070.679289:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788792070.679301:0:23400:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8c60433e0000) 00000020:00000080:0.0:1788792070.679316:0:23400:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788792070.679322:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788792070.679451:0:23400:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788792070.679458:0:23400:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788792070.679465:0:23400:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4d37c11031f3635b 00010000:00080000:0.0:1788792070.679494:0:23400:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c6043e91000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.120@tcp at head 00010000:00010000:0.0:1788792070.679701:0:23400:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788792070.679777:0:23400:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788792070.679791:0:23400:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788792070.680025:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788792070.680031:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788792070.680034:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788792070.680036:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788792070.682033:0:23400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788792070.682465:0:23400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788792070.682616:0:23400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788792070.684253:0:23408:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788792070.684260:0:23408:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788792070.685241:0:23400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788792070.685254:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788792070.685292:0:23400:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788792070.685314:0:23400:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4d37c11031f36362 00000100:00080000:1.0:1788792070.685331:0:23400:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788792070.685337:0:23400:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c6043e91000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792070.685385:0:23400:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d16680 x1875683785816192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788792070.685414:0:23400:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788792070.685466:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792070.685470:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792070.685472:0:23400:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788792070.685475:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788792070.685479:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792070.685480:0:23400:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788792070.685483:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788792070.685485:0:23400:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788792070.685487:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792070.685489:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792070.685491:0:23400:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788792070.685493:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788792070.685495:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792070.685496:0:23400:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788792070.685499:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788792070.685524:0:23400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792070.685527:0:23400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792070.685528:0:23400:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788792070.685531:0:23400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:0.0:1788792070.685723:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788792070.685729:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788792070.685732:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788792070.685735:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1788792070.685791:0:23396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788792070.685838:0:23396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788792070.685861:0:23396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b952000/0x4d37c11031f362e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f362eb expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.685896:0:23396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c617b952000/0x4d37c11031f362e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f362eb expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788792070.685905:0:23396:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c617f976000 from 1 10000000:01000000:3.0:1788792070.685908:0:23396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788792070.685934:0:23396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.685942:0:23396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.685955:0:23396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792070.685975:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785816320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788792070.686049:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792070.686099:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6142bea3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788792070.686121:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785816192:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788792070.686148:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683785816192 offset 0 length 520: 4 00000100:00100000:1.0:1788792070.686419:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785816320 00000100:00100000:1.0:1788792070.686427:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785816320 00000100:00100000:1.0:1788792070.686481:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788792070.686490:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+15:23396:x1875683785816320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788792070.686504:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788792070.686517:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6141689e00/0x4d37c11031f36370 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f36369 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792070.686554:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6141689e00/0x4d37c11031f36370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f36369 expref: 16 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792070.686564:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6141689e00/0x4d37c11031f36370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36369 expref: 16 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792070.686573:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6141689e00, rc 0) 00000100:00100000:1.0:1788792070.686619:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+16:23396:x1875683785816320:12345-0@lo:101:mount.lustre.0 Request processed in 130us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792070.686626:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788792070.686703:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785816320:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788792070.686717:0:23396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36370 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.686731:0:23396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f36370 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792070.687331:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785816448:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788792070.687554:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.687595:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61603a20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788792070.687717:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785816448 00000100:00100000:1.0:1788792070.687724:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785816448 00000100:00100000:1.0:1788792070.687773:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788792070.687782:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+16:23396:x1875683785816448:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788792070.687912:0:22658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788792070.687935:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788792070.687939:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788792070.688026:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+16:23396:x1875683785816448:12345-0@lo:256:mount.lustre.0 Request processed in 244us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792070.688037:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788792070.688130:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785816448:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788792070.688687:0:23396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788792070.688711:0:23396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36370 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.688723:0:23396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36370 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792070.688731:0:23396:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c617f976000 from 1 10000000:01000000:0.0:1788792070.688733:0:23396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788792070.688759:0:23396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.688768:0:23396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.688777:0:23396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792070.688794:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785816576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788792070.689076:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.689125:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61603a20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788792070.689213:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785816576 00000100:00100000:3.0:1788792070.689221:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785816576 00000100:00100000:3.0:1788792070.689263:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788792070.689271:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+16:23396:x1875683785816576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788792070.689282:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792070.689295:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6181362200/0x4d37c11031f3637e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f36377 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.689315:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6181362200/0x4d37c11031f3637e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f36377 expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.689324:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6181362200/0x4d37c11031f3637e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36377 expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.689334:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6181362200, rc 0) 00000100:00100000:3.0:1788792070.689389:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+17:23396:x1875683785816576:12345-0@lo:101:mount.lustre.0 Request processed in 118us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792070.689395:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788792070.689441:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785816576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788792070.689456:0:23396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3637e expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.689468:0:23396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f3637e expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788792070.691590:0:23396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1788792070.692065:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788792070.692367:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788792070.692393:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1788792070.692407:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1788792070.692434:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1788792070.692448:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1788792070.692460:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1788792070.692471:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1788792070.692483:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1788792070.692494:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788792070.692506:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1788792070.692518:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1788792070.692535:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1788792070.692540:0:23396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1788792070.692622:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785816704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788792070.692691:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792070.692832:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6142bea840 going to sleep for 11 seconds 00000100:00100000:0.0:1788792070.693027:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785816704 00000100:00100000:0.0:1788792070.693036:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785816704 00000100:00100000:0.0:1788792070.693170:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788792070.693182:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+17:23396:x1875683785816704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788792070.693377:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+17:23396:x1875683785816704:12345-0@lo:501:mount.lustre.0 Request processed in 196us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792070.693386:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788792070.693524:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785816704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788792070.693563:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785816832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788792070.693610:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792070.693641:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6142bea840 going to sleep for 11 seconds 00000100:00100000:1.0:1788792070.693686:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785816832 00000100:00100000:1.0:1788792070.693692:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785816832 00000100:00100000:1.0:1788792070.693732:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788792070.693739:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+17:23396:x1875683785816832:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788792070.694006:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+17:23396:x1875683785816832:12345-0@lo:503:mount.lustre.0 Request processed in 266us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792070.694024:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788792070.694128:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785816832:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788792070.694635:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788792070.694712:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785816960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788792070.694750:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792070.694787:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61582183c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788792070.695023:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785816960 00000100:00100000:1.0:1788792070.695029:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785816960 00000100:00100000:1.0:1788792070.695068:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788792070.695077:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+17:23396:x1875683785816960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788792070.695254:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+17:23396:x1875683785816960:12345-0@lo:502:mount.lustre.0 Request processed in 178us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792070.695262:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788792070.697442:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785816960:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788792070.697790:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788792070.698115:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1788792070.698132:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1788792070.698143:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1788792070.698154:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1788792070.698246:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1788792070.698260:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1788792070.698271:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1788792070.698281:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788792070.698291:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1788792070.698302:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1788792070.698361:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785817088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792070.698441:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.698523:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61603a2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788792070.698576:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785817088 00000100:00100000:1.0:1788792070.698585:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785817088 00000100:00100000:1.0:1788792070.698666:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788792070.698675:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+17:23396:x1875683785817088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792070.698912:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785817088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788792070.698961:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:0.0:1788792070.698970:0:23396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:1.0:1788792070.699674:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+17:23396:x1875683785817088:12345-0@lo:502:mount.lustre.0 Request processed in 125us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792070.699685:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000020:01000000:0.0:1788792070.699936:0:23410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788792070.699944:0:23410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792070.699946:0:23410:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788792070.699953:0:23410:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c617f976000 00000020:00000080:0.0:1788792070.699956:0:23410:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788792070.699969:0:23410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788792070.699972:0:23410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792070.699973:0:23410:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788792070.699975:0:23410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788792070.699978:0:23410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792070.699979:0:23410:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788792070.699982:0:23410:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c617f976000 00000020:00000080:0.0:1788792070.699985:0:23410:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788792070.700040:0:23410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788792070.700043:0:23410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792070.700044:0:23410:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788792070.700046:0:23410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788792070.700049:0:23410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792070.700050:0:23410:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788792070.700053:0:23410:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c617f976000 00000020:00000080:0.0:1788792070.700055:0:23410:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788792070.700070:0:23410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788792070.700072:0:23410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792070.700073:0:23410:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788792070.700075:0:23410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788792070.700077:0:23410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792070.700078:0:23410:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788792070.700081:0:23410:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c617f976000 00000020:00000080:0.0:1788792070.700083:0:23410:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788792070.700100:0:23410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788792070.700102:0:23410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792070.700103:0:23410:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788792070.700106:0:23410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1788792070.707927:0:23396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788792070.707973:0:23396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788792070.707997:0:23396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3637e expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792070.708011:0:23396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3637e expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788792070.708070:0:23396:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788792070.708073:0:23396:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c617f976000 10000000:01000000:2.0:1788792070.708075:0:23396:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c617f976000 10000000:01000000:2.0:1788792070.708079:0:23396:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788792070.708084:0:23396:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c617f976000 from 1 10000000:01000000:2.0:1788792070.708086:0:23396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788792070.708120:0:23396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c618217ec00/0x4d37c11031f36385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792070.708128:0:23396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c618217ec00/0x4d37c11031f36385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792070.708139:0:23396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c618217ec00/0x4d37c11031f36385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792070.708163:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785817216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788792070.708231:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792070.708270:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785817216 00000100:00100000:2.0:1788792070.708277:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785817216 00000100:00100000:2.0:1788792070.708316:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788792070.708324:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+17:23396:x1875683785817216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788792070.708345:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792070.708370:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c618217f600/0x4d37c11031f3638c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f36385 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792070.708391:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c618217f600/0x4d37c11031f3638c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f36385 expref: 18 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792070.708402:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c618217f600/0x4d37c11031f3638c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36385 expref: 18 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792070.708411:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c618217f600, rc 0) 00000100:00100000:2.0:1788792070.708440:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+18:23396:x1875683785817216:12345-0@lo:101:mount.lustre.0 Request processed in 117us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792070.708447:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788792070.708487:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6158218780 going to sleep for 11 seconds 00000100:00100000:2.0:1788792070.708505:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785817216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788792070.708517:0:23396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c618217ec00/0x4d37c11031f36385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3638c expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792070.708527:0:23396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c618217ec00/0x4d37c11031f36385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f3638c expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788792070.709786:0:23396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788792070.710067:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788792070.710233:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788792070.710255:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788792070.710267:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788792070.710278:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788792070.710300:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788792070.710318:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788792070.710331:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788792070.710343:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788792070.710366:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788792070.710378:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788792070.710389:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788792070.710400:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788792070.710411:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788792070.710422:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788792070.710433:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788792070.710443:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788792070.710454:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788792070.710465:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788792070.710476:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788792070.710487:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788792070.710508:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788792070.710520:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788792070.710531:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788792070.710542:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788792070.710553:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788792070.710565:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788792070.710577:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788792070.710589:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788792070.710599:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788792070.710610:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788792070.710621:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788792070.710632:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788792070.710643:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788792070.710654:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788792070.710665:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788792070.710675:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788792070.710701:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788792070.710717:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788792070.710741:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788792070.710755:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788792070.710769:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788792070.710779:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788792070.710791:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788792070.710804:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788792070.710816:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788792070.710828:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788792070.710839:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788792070.710850:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788792070.710996:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788792070.711018:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788792070.711033:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788792070.711039:0:23396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788792070.711130:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785817344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788792070.711196:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792070.711230:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6158218300 going to sleep for 11 seconds 00000100:00100000:1.0:1788792070.711938:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785817344 00000100:00100000:1.0:1788792070.711948:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785817344 00000100:00100000:1.0:1788792070.712002:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788792070.712012:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+18:23396:x1875683785817344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788792070.712146:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+18:23396:x1875683785817344:12345-0@lo:501:mount.lustre.0 Request processed in 134us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792070.712154:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788792070.715657:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785817344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788792070.715747:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785817472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788792070.717000:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792070.717042:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785817472 00000100:00100000:2.0:1788792070.717049:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785817472 00000100:00100000:2.0:1788792070.717106:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788792070.717116:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+18:23396:x1875683785817472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788792070.717242:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+18:23396:x1875683785817472:12345-0@lo:503:mount.lustre.0 Request processed in 126us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792070.717250:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788792070.717300:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6158218300 going to sleep for 11 seconds 00000100:00100000:2.0:1788792070.717338:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785817472:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788792070.728690:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788792070.728825:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785817600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788792070.728925:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792070.728977:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60435d29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788792070.729833:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785817600 00000100:00100000:0.0:1788792070.729841:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785817600 00000100:00100000:0.0:1788792070.729913:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788792070.729923:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+18:23396:x1875683785817600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792070.730058:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+18:23396:x1875683785817600:12345-0@lo:502:mount.lustre.0 Request processed in 137us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792070.730073:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788792070.730256:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785817600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788792070.730496:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788792070.730524:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788792070.730536:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788792070.730546:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788792070.730557:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788792070.730568:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788792070.730580:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788792070.730592:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788792070.730603:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788792070.730614:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788792070.730625:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788792070.730636:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788792070.730647:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788792070.730658:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788792070.730682:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788792070.730695:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788792070.730706:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788792070.730717:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788792070.730728:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788792070.730739:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788792070.730750:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788792070.730761:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788792070.730772:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788792070.730783:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788792070.730816:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788792070.730828:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788792070.730839:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788792070.730850:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788792070.730861:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788792070.730899:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788792070.730923:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788792070.730936:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788792070.730946:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788792070.730957:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788792070.730967:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788792070.730978:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788792070.730989:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788792070.731000:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788792070.731010:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788792070.731021:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788792070.731032:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788792070.731043:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788792070.731053:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788792070.731064:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788792070.731075:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788792070.731085:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788792070.731105:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788792070.731118:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788792070.731160:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785817728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788792070.731212:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792070.731245:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60435d29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788792070.731473:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785817728 00000100:00100000:0.0:1788792070.731483:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785817728 00000100:00100000:0.0:1788792070.731529:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788792070.731537:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+18:23396:x1875683785817728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792070.731656:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+18:23396:x1875683785817728:12345-0@lo:502:mount.lustre.0 Request processed in 118us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792070.731663:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788792070.731754:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785817728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788792070.732021:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788792070.732043:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788792070.732064:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785817856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788792070.732102:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792070.732125:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785817856 00000100:00100000:2.0:1788792070.732128:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785817856 00000100:00100000:2.0:1788792070.732907:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788792070.732918:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+18:23396:x1875683785817856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788792070.733021:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+18:23396:x1875683785817856:12345-0@lo:502:mount.lustre.0 Request processed in 105us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792070.733028:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788792070.733526:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60435d29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788792070.733571:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785817856:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788792070.733657:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1788792070.733679:0:23396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788792070.735235:0:23415:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788792070.735254:0:23415:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8c6150e24d28) 00000020:00000080:1.0:1788792070.735277:0:23415:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788792070.735398:0:23415:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c617f976000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788792070.735407:0:23415:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c617f976000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788792070.735410:0:23415:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c617f976000 3 00010000:00080000:1.0:1788792070.735445:0:23415:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c6175c23800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788792070.738145:0:23415:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788792070.738485:0:23415:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788792070.738526:0:23415:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788792070.738540:0:23415:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4d37c11031f3639a 00000100:00080000:1.0:1788792070.738552:0:23415:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788792070.738557:0:23415:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c6175c23800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792070.738596:0:23415:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d16300 x1875683785817984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788792070.738627:0:23415:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788792070.738656:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792070.738660:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788792070.738663:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792070.738666:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788792070.738740:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875683785817984:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788792070.738830:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788792070.739995:0:23415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00100000:2.0:1788792070.740627:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785817984 00000100:00100000:2.0:1788792070.740639:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785817984 00000100:00100000:2.0:1788792070.740684:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788792070.740692:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875683785817984:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788792070.740719:0:22666:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:2.0:1788792070.740752:0:22666:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4d37c11031f363a1 00000004:00100000:2.0:1788792070.740767:0:22666:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:0.0:1788792070.742363:0:23396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788792070.742404:0:23396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788792070.742422:0:23396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c618217ec00/0x4d37c11031f36385 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3638c expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792070.742434:0:23396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c618217ec00/0x4d37c11031f36385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3638c expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788792070.742495:0:23396:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788792070.742497:0:23396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788792070.742498:0:23396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788792070.742499:0:23396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788792070.742500:0:23396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788792070.742502:0:23396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788792070.742503:0:23396:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788792070.742504:0:23396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788792070.742506:0:23396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788792070.742510:0:23396:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788792070.742513:0:23396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788792070.742514:0:23396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788792070.742520:0:23396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788792070.742521:0:23396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788792070.742522:0:23396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788792070.742523:0:23396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788792070.742524:0:23396:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788792070.742525:0:23396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788792070.742526:0:23396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788792070.742553:0:23396:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788792070.742573:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785818112:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788792070.742653:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.742698:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785818112 00000100:00100000:0.0:1788792070.742705:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785818112 00000100:00100000:0.0:1788792070.742751:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788792070.742759:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+18:23396:x1875683785818112:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788792070.742789:0:22659:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788792070.742816:0:22659:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788792070.743121:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61603a2c00 going to sleep for 11 seconds 00000001:00100000:0.0:1788792070.744056:0:22644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788792070.744081:0:22659:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788792070.744094:0:22659:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00080000:2.0:1788792070.744293:0:22666:0:(import.c:65:import_set_state_nolock()) ffff8c614f114000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788792070.744414:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875683785817984:12345-0@lo:38:llog_process_th.0 Request processed in 3718us (5580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792070.744423:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788792070.744939:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c6043d16300 x1875683785817984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788792080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792070.744951:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788792070.744959:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788792070.744967:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788792070.744973:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788792070.744976:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6175c23800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788792070.744983:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875683785817984:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788792070.745063:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+18:23396:x1875683785818112:12345-0@lo:253:mount.lustre.0 Request processed in 2304us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792070.745088:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788792070.745141:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:23396:1875683785818112:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788792070.745154:0:23396:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788792070.745157:0:23396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788792070.745869:0:23396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788792070.745893:0:23396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788792070.745895:0:23396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788792070.745897:0:23396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788792070.745898:0:23396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788792070.745900:0:23396:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788792070.745902:0:23396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788792070.745903:0:23396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788792070.745919:0:23396:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788792070.746303:0:22680:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788792070.746309:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788792070.746336:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.746364:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c6181362000/0x4d37c11031f362ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f362a5 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.746373:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c6141689e00/0x4d37c11031f36370 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36369 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.746381:0:22680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.746422:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c6141689e00/0x4d37c11031f36370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4d37c11031f36369 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.746439:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c6141689e00/0x4d37c11031f36370 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4d37c11031f36369 expref: 17 pid: 22657 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792070.746454:0:22680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875683785818240:0@lo:104: 00000100:00100000:3.0:1788792070.746511:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788792070.746546:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c6181362000/0x4d37c11031f362ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4d37c11031f362a5 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.746553:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c6181362000/0x4d37c11031f362ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4d37c11031f362a5 expref: 17 pid: 22657 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792070.746561:0:22680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875683785818368:0@lo:104: 00000100:00100000:3.0:1788792070.746591:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792070.746606:0:22680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6175e14b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788792070.746644:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785818240 00000100:00100000:3.0:1788792070.746650:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785818240 00000100:00100000:3.0:1788792070.746679:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785818368 00000100:00100000:3.0:1788792070.746681:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785818368 00000100:00100000:3.0:1788792070.746693:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788792070.746701:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+4:22680:x1875683785818240:12345-0@lo:104: 00010000:00010000:3.0:1788792070.746714:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f36370 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.746760:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788792070.746767:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+4:22680:x1875683785818240:12345-0@lo:104: Request processed in 66us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792070.746773:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788792070.746791:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788792070.746811:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+3:22680:x1875683785818368:12345-0@lo:104: 00010000:00010000:3.0:1788792070.746820:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f362ac expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.746851:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788792070.746856:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+3:22680:x1875683785818368:12345-0@lo:104: Request processed in 60us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792070.746862:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788792070.746898:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788792070.746904:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f36370 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.746912:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6181362400 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:3.0:1788792070.746922:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4d37c11031f36370 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.746931:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4d37c11031f36370 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788792070.746939:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4d37c11031f36370 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788792070.746945:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788792070.746976:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f36370 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.746983:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788792070.747004:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f36370 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.747011:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c6181362400/0x4d37c11031f36369 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f36370 expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.747023:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792070.747026:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f362ac expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.747033:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b953a00 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:3.0:1788792070.747036:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4d37c11031f362ac expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.747042:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4d37c11031f362ac expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788792070.747057:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4d37c11031f362ac expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788792070.747064:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788792070.747075:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f362ac expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.747080:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788792070.747086:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f362ac expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.747092:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c617b953a00/0x4d37c11031f362a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f362ac expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.747103:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792070.747105:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792070.747106:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792070.747112:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788792070.747129:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785818496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788792070.747156:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792070.749276:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788792070.749294:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785818624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788792070.749358:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792070.749466:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785818496 00000100:00100000:3.0:1788792070.749474:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785818496 00010000:00010000:3.0:1788792070.749505:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c6141689e00/0x4d37c11031f36370 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f36369 expref: 18 pid: 22657 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792070.749531:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785818624 00000100:00100000:3.0:1788792070.749539:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785818624 00010000:00010000:3.0:1788792070.749552:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c6181362000/0x4d37c11031f362ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f362a5 expref: 19 pid: 22657 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792070.749568:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788792070.749576:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a140336d-9a80-41e1-97b0-93600c05b204+19:3643:x1875683785818496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788792070.749589:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788792070.749594:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c6141689e00/0x4d37c11031f36370 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f36369 expref: 19 pid: 22657 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749607:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c6141689e00/0x4d37c11031f36370 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4d37c11031f36369 expref: 19 pid: 22657 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749629:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788792070.749663:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a140336d-9a80-41e1-97b0-93600c05b204+19:3643:x1875683785818496:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792070.749670:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788792070.749686:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788792070.749691:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a140336d-9a80-41e1-97b0-93600c05b204+18:3643:x1875683785818624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788792070.749698:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788792070.749702:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c6181362000/0x4d37c11031f362ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f362a5 expref: 18 pid: 22657 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749711:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c6181362000/0x4d37c11031f362ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4d37c11031f362a5 expref: 18 pid: 22657 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749723:0:22650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749731:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788792070.749751:0:22650:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003443038s 00010000:00010000:3.0:1788792070.749756:0:22650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749764:0:22650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749770:0:22650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749777:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749784:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6181362800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792070.749788:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749796:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749804:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749813:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788792070.749832:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a140336d-9a80-41e1-97b0-93600c05b204+18:3643:x1875683785818624:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792070.749837:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788792070.749897:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6141689e00/0x4d37c11031f36370 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4d37c11031f36369 expref: 17 pid: 22657 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792070.749920:0:22680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875683785818240:0@lo:104: 00010000:00010000:3.0:1788792070.749934:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6181362000/0x4d37c11031f362ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4d37c11031f362a5 expref: 16 pid: 22657 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792070.749943:0:22680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875683785818368:0@lo:104: 00010000:00010000:3.0:1788792070.749960:0:22680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749968:0:22680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749975:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792070.749981:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6181362800/0x4d37c11031f363a8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792070.750003:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785818624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788792070.750009:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785818496:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1788792070.756664:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788792070.756953:0:23420:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788792070.756957:0:23420:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788792070.757086:0:23421:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788792070.757478:0:23421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788792070.759681:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788792070.759758:0:23421:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788792070.760036:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788792070.765997:0:23422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23422:1875683785818752:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788792070.766074:0:23422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.766116:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785818752 00000100:00100000:0.0:1788792070.766125:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785818752 00000100:00100000:0.0:1788792070.766185:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788792070.766196:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23422:x1875683785818752:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788792070.766290:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23422:x1875683785818752:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 95us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792070.766298:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788792070.766325:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60437c1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788792070.766365:0:23422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23422:1875683785818752:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788792070.766398:0:23422:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788792070.766427:0:23422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23422:1875683785818880:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788792070.766458:0:23422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.766475:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60437c1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788792070.766557:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785818880 00000100:00100000:1.0:1788792070.766563:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785818880 00000100:00100000:1.0:1788792070.766596:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788792070.766604:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23422:x1875683785818880:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788792070.766730:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23422:x1875683785818880:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 127us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792070.766736:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:01000000:1.0:1788792070.766932:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788792070.766983:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788792070.767391:0:23396:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788792070.767400:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788792070.767436:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788792070.768415:0:23396:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788792070.769005:0:23396:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788792070.769038:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788792070.769193:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788792070.769581:0:23422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23422:1875683785818880:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788792070.769669:0:23422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23422:1875683785819008:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788792070.769729:0:23422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.769777:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785819008 00000100:00100000:0.0:1788792070.769784:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785819008 00000100:00100000:0.0:1788792070.769904:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788792070.769914:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23422:x1875683785819008:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788792070.769960:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23422:x1875683785819008:12345-0@lo:900:lod0001_rec0000.0 Request processed in 48us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792070.769967:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788792070.769991:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60437c1b40 going to sleep for 11 seconds 00010000:00080000:0.0:1788792070.770010:0:23422:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c6043dc8700 x1875683785819008/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788792086 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792070.770021:0:23422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23422:1875683785819008:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788792070.770067:0:23422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23422:1875683785819136:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788792070.770094:0:23422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792070.770117:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60437c1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788792070.770221:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785819136 00000100:00100000:1.0:1788792070.770226:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785819136 00000100:00100000:1.0:1788792070.770261:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788792070.770268:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23422:x1875683785819136:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788792070.770329:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23422:x1875683785819136:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 62us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792070.770336:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00080000:10000000:1.0:1788792070.771053:0:23396:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:1.0:1788792070.772566:0:23396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1788792070.773118:0:23422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23422:1875683785819136:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788792070.773179:0:23422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788792070.780062:0:23422:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788792070.780146:0:23422:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788792070.780152:0:23422:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1788792070.781137:0:23396:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788792070.781169:0:23396:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9d26014eb988 00100000:10000000:1.0:1788792070.781179:0:23396:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788792070.787557:0:23396:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788792070.787600:0:23396:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788792070.787619:0:23396:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788792070.787636:0:23396:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788792070.804617:0:23396:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788792070.805484:0:23396:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788792071.191063:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788792071.643431:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00000040:00080000:2.0:1788792071.774639:0:23423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788792071.831578:0:22661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788792071.831604:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c617f976000 from 12 10000000:01000000:0.0:1788792071.831612:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788792071.831666:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792071.831678:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792071.831691:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792071.831722:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785819264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788792071.831795:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792071.831842:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60437c1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788792071.831922:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785819264 00000100:00100000:2.0:1788792071.831931:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785819264 00000100:00100000:2.0:1788792071.831984:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788792071.831994:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+16:22661:x1875683785819264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788792071.832007:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792071.832024:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6140030a00/0x4d37c11031f363b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f363af expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792071.832052:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6140030a00/0x4d37c11031f363b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f363af expref: 17 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792071.832065:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6140030a00/0x4d37c11031f363b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f363af expref: 17 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792071.832075:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140030a00, rc 0) 00000100:00100000:2.0:1788792071.832132:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+17:22661:x1875683785819264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792071.832138:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788792071.832352:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785819264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788792071.832369:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f363b6 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792071.832378:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f363b6 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792071.832447:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785819392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788792071.832489:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792071.832510:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6043656840 going to sleep for 11 seconds 00000100:00100000:0.0:1788792071.832668:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785819392 00000100:00100000:0.0:1788792071.832674:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785819392 00000100:00100000:0.0:1788792071.832708:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788792071.832716:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+17:22661:x1875683785819392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788792071.832732:0:22657:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788792071.832751:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788792071.832754:0:22657:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788792071.832833:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+17:22661:x1875683785819392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792071.832840:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788792071.832891:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785819392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788792071.832939:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788792071.832945:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f363b6 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792071.832963:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f363b6 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792071.832973:0:22661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788792071.832975:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c617fa8f000 from 12 10000000:01000000:0.0:1788792071.832978:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788792071.832997:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792071.833004:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792071.833013:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792071.833024:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785819520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788792071.833052:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792071.833067:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60437c1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788792071.833079:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785819520 00000100:00100000:0.0:1788792071.833083:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785819520 00000100:00100000:0.0:1788792071.833100:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788792071.833257:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+17:22661:x1875683785819520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788792071.833267:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788792071.833282:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c617b952c00/0x4d37c11031f363c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f363bd expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792071.833299:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c617b952c00/0x4d37c11031f363c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f363bd expref: 18 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792071.833318:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c617b952c00/0x4d37c11031f363c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f363bd expref: 18 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792071.833325:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c617b952c00, rc 0) 00000100:00100000:0.0:1788792071.833365:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+18:22661:x1875683785819520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792071.833371:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788792071.833399:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785819520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788792071.833409:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f363c4 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792071.833416:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f363c4 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792071.833663:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785819648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788792071.833692:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792071.837460:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60437c1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788792071.838392:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785819648 00000100:00100000:2.0:1788792071.838405:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785819648 00000100:00100000:2.0:1788792071.838586:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788792071.838597:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+18:22661:x1875683785819648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788792071.838623:0:22657:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788792071.838645:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788792071.838649:0:22657:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788792071.838777:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+18:22661:x1875683785819648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 182us (5084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792071.838784:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788792071.838836:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785819648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788792071.838922:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788792071.838933:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f363c4 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792071.838945:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f363c4 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792072.215365:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788792072.678917:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00000040:00080000:3.0:1788792072.795335:0:23423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788792073.240451:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788792073.692533:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:0.0:1788792074.262249:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788792074.713602:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00010000:00010000:3.0:1788792075.291528:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788792075.603736:0:23666:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788792075.734028:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 0 seconds 00000100:00100000:1.0:1788792075.808852:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785819776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788792075.808951:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792075.809039:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785819776 00000100:00100000:1.0:1788792075.809048:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785819776 00000100:00100000:1.0:1788792075.809110:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788792075.809120:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785819776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788792075.809157:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788792075.809210:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785819776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792075.809219:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788792075.809279:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785819776:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788792075.810995:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788792075.811008:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788792075.811013:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c61813c7000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788792075.811026:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c61813c7000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788792075.811052:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6151f4df80 x1875683785820032/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788792075.811071:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792075.811075:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792075.811077:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792075.811080:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792075.811099:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792075.811103:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792075.811105:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792075.811108:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788792075.811156:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785820032:0@lo:38:kworker.0 00000100:00100000:3.0:1788792075.811216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792075.811288:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875683785820160:0@lo:400:kworker.0 00000100:00100000:3.0:1788792075.811321:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792075.811346:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788792075.811351:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875683785820288:0@lo:400:kworker.0 00000100:00100000:3.0:1788792075.811376:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792075.811407:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785820032 00000100:00100000:3.0:1788792075.811415:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785820032 00000100:00100000:3.0:1788792075.811450:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788792075.811466:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875683785820032:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788792075.811498:0:22670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:3.0:1788792075.811533:0:22670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4d37c11031f363cb 00000004:00100000:3.0:1788792075.811547:0:22670:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788792075.811553:0:22670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788792075.811636:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785820160 00000100:00100000:3.0:1788792075.811641:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785820160 00000100:00100000:3.0:1788792075.811676:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785820288 00000100:00100000:3.0:1788792075.811679:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785820288 00000100:00100000:3.0:1788792075.811693:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788792075.811699:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875683785820160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792075.811751:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875683785820160:12345-0@lo:400:kworker.0 Request processed in 52us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792075.811759:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788792075.811776:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788792075.811782:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875683785820288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792075.811807:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875683785820288:12345-0@lo:400:kworker.0 Request processed in 25us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792075.811813:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788792075.811849:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c6151f4c000 x1875683785820288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792075.811862:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875683785820288:0@lo:400:kworker.0 00010000:00080000:3.0:1788792075.811898:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c6151f4d500 x1875683785820160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792075.811906:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875683785820160:0@lo:400:kworker.0 00000100:00100000:3.0:1788792075.811936:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a140336d-9a80-41e1-97b0-93600c05b204:3642:1875683785819904:0@lo:400:kworker.0 00000100:00100000:3.0:1788792075.811968:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792075.812003:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785819904 00000100:00100000:3.0:1788792075.812006:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785819904 00000100:00100000:3.0:1788792075.812029:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788792075.812035:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+18:3642:x1875683785819904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792075.812063:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+18:3642:x1875683785819904:12345-0@lo:400:kworker.0 Request processed in 28us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792075.812069:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788792075.812098:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a140336d-9a80-41e1-97b0-93600c05b204:3642:1875683785819904:0@lo:400:kworker.0 00000100:00080000:3.0:1788792075.818532:0:22670:0:(import.c:65:import_set_state_nolock()) ffff8c6174eaf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788792075.818656:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875683785820032:12345-0@lo:38:kworker.0 Request processed in 7188us (7437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792075.818669:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788792075.820891:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788792075.820909:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788792075.820916:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788792075.820920:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c61813c7000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788792075.820945:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000073e63416): req@ffff8c6043dc8e00 x1875683785812992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788792075.820965:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785820032:0@lo:38:kworker.0 00000100:00100000:2.0:1788792075.821066:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792075.821100:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c604247dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788792075.821123:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785812992 00000100:00100000:2.0:1788792075.821130:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785812992 00000100:00100000:2.0:1788792075.821176:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788792075.821184:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22706:x1875683785812992:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788792075.821272:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22706:x1875683785812992:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792075.821279:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788792075.821308:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1875683785812992:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788792075.821346:0:22706:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788792075.821395:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1875683785820416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788792075.821422:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792075.821445:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788792075.821456:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785820416 00000100:00100000:2.0:1788792075.821459:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785820416 00000100:00100000:2.0:1788792075.821477:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788792075.821482:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22706:x1875683785820416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788792075.821563:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22706:x1875683785820416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792075.821569:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788792075.821590:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1875683785820416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788792075.821652:0:22706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1875683785820544:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788792075.821671:0:22706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792075.821683:0:22706:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788792075.821692:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785820544 00000100:00100000:2.0:1788792075.821695:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785820544 00000100:00100000:2.0:1788792075.823862:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788792075.823903:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22706:x1875683785820544:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788792075.824061:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22706:x1875683785820544:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 168us (2386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792075.824070:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788792075.824135:0:22706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1875683785820544:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788792075.824207:0:22706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788792075.833926:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788792075.833949:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785820672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788792075.834025:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788792075.836746:0:22706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788792075.836860:0:22706:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:2.0:1788792075.836866:0:22706:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:2.0:1788792075.836986:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785820672 00000100:00100000:2.0:1788792075.836998:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785820672 00000100:00100000:2.0:1788792075.837071:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788792075.837084:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875683785820672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788792075.837136:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788792075.837244:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875683785820672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 162us (3219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792075.837252:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788792075.838501:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785820672:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788792076.311177:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788792076.800954:0:23718:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788792076.801157:0:23718:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788792077.338936:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788792077.690663:0:23768:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788792077.691157:0:23768:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788792077.720815:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788792078.358785:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788792078.773823:0:23816:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0689bf10 20000000:00000080:0.0:1788792078.773844:0:23816:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c614f042000 uarg=0000000000000000 20000000:01000000:0.0:1788792078.773913:0:23816:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788792078.773921:0:23816:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788792078.773931:0:23816:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788792078.776064:0:23817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788792078.776312:0:23816:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788792078.798602:0:23816:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788792078.812277:0:23816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.812302:0:23816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c6141688800/0x4d37c11031f3627b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36274 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.812323:0:23816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c6181362200/0x4d37c11031f3637e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36377 expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.812331:0:23816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.812375:0:23816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c6181362200/0x4d37c11031f3637e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4d37c11031f36377 expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.812393:0:23816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c6181362200/0x4d37c11031f3637e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4d37c11031f36377 expref: 17 pid: 22659 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792078.812408:0:23816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23816:1875683785820800:0@lo:104: 00000100:00100000:1.0:1788792078.812476:0:23816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788792078.812541:0:23816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c6141688800/0x4d37c11031f3627b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4d37c11031f36274 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.812549:0:23816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c6141688800/0x4d37c11031f3627b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4d37c11031f36274 expref: 17 pid: 22657 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792078.812558:0:23816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23816:1875683785820928:0@lo:104: 00000100:00100000:1.0:1788792078.812580:0:23816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792078.815709:0:23816:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6174ce2300 going to sleep for 11 seconds 00000100:00100000:2.0:1788792078.816264:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785820800 00000100:00100000:2.0:1788792078.816277:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785820800 00000100:00100000:2.0:1788792078.816321:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785820928 00000100:00100000:2.0:1788792078.816324:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785820928 00000100:00100000:2.0:1788792078.816340:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788792078.816350:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+4:23816:x1875683785820800:12345-0@lo:104: 00010000:00010000:2.0:1788792078.817024:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f3637e expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792078.817297:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788792078.817305:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+4:23816:x1875683785820800:12345-0@lo:104: Request processed in 956us (4828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792078.817315:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788792078.817339:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788792078.817347:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+3:23816:x1875683785820928:12345-0@lo:104: 00010000:00010000:2.0:1788792078.817358:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f3627b expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792078.817459:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788792078.817464:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+3:23816:x1875683785820928:12345-0@lo:104: Request processed in 119us (4883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792078.817470:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788792078.817491:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788792078.817497:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f3637e expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792078.817505:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b952400 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:2.0:1788792078.817509:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4d37c11031f3637e expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792078.817517:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4d37c11031f3637e expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788792078.817524:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4d37c11031f3637e expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788792078.817529:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788792078.817566:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3637e expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792078.817572:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788792078.817587:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3637e expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792078.817594:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c617b952400/0x4d37c11031f36377 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3637e expref: -99 pid: 23396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792078.817618:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788792078.817621:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f3627b expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792078.817627:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b953200 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:2.0:1788792078.817630:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4d37c11031f3627b expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792078.817636:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4d37c11031f3627b expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788792078.817642:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4d37c11031f3627b expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788792078.817647:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788792078.817777:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a140336d-9a80-41e1-97b0-93600c05b204:3642:1875683785821056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788792078.817823:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792078.817900:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785821056 00000100:00100000:1.0:1788792078.817906:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785821056 00010000:00010000:1.0:1788792078.817929:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c6181362200/0x4d37c11031f3637e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f36377 expref: 18 pid: 22659 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792078.817957:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788792078.817961:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a140336d-9a80-41e1-97b0-93600c05b204+18:3642:x1875683785821056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788792078.817970:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788792078.817974:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c6181362200/0x4d37c11031f3637e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f36377 expref: 18 pid: 22659 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.817982:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c6181362200/0x4d37c11031f3637e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4d37c11031f36377 expref: 18 pid: 22659 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.818001:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788792078.818030:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a140336d-9a80-41e1-97b0-93600c05b204+18:3642:x1875683785821056:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792078.818036:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788792078.818082:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a140336d-9a80-41e1-97b0-93600c05b204:3642:1875683785821056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788792078.818326:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3627b expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792078.818333:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788792078.818350:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3627b expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792078.818357:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c617b953200/0x4d37c11031f36274 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3627b expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792078.818510:0:23816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6181362200/0x4d37c11031f3637e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4d37c11031f36377 expref: 17 pid: 22659 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792078.818522:0:23816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23816:1875683785820800:0@lo:104: 00000100:00100000:3.0:1788792078.818532:0:23816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23816:1875683785820928:0@lo:104: 00010000:00010000:3.0:1788792078.818549:0:23816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792078.818592:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785821184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788792078.818625:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788792078.818690:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792078.818793:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792078.818795:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792078.818797:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788792078.818988:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785821184 00000100:00100000:1.0:1788792078.818994:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785821184 00010000:00010000:1.0:1788792078.819017:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c6141688800/0x4d37c11031f3627b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f36274 expref: 17 pid: 22657 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792078.819039:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788792078.819046:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a140336d-9a80-41e1-97b0-93600c05b204+17:3643:x1875683785821184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788792078.819056:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788792078.819061:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c6141688800/0x4d37c11031f3627b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f36274 expref: 17 pid: 22657 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.819070:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c6141688800/0x4d37c11031f3627b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4d37c11031f36274 expref: 17 pid: 22657 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.819095:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6141688800/0x4d37c11031f3627b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4d37c11031f36274 expref: 17 pid: 22657 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.819114:0:22650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.819121:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.819141:0:22650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.819149:0:22650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.819155:0:22650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.819161:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.819166:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792078.819170:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.819177:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.819192:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792078.819224:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788792078.819318:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a140336d-9a80-41e1-97b0-93600c05b204+16:3643:x1875683785821184:12345-0@lo:103:ldlm_bl.0 Request processed in 271us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792078.819326:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788792078.819793:0:23816:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792078.819809:0:23816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792078.819816:0:23816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6141689000/0x4d37c11031f363d2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792078.824287:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785821184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788792079.382145:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788792079.829989:0:22661:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788792079.829997:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c617f976000 from 13 10000000:01000000:3.0:1788792079.830003:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788792079.830048:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792079.830060:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792079.830072:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792079.830100:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785821312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788792079.830167:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792079.832302:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b3840 going to sleep for 11 seconds 00000100:00100000:1.0:1788792079.833176:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785821312 00000100:00100000:1.0:1788792079.833199:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785821312 00000100:00100000:0.0:1788792079.841442:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788792079.841457:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+16:22661:x1875683785821312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788792079.841477:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788792079.841498:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c617b953600/0x4d37c11031f363e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f363d9 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792079.841527:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c617b953600/0x4d37c11031f363e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f363d9 expref: 17 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792079.841539:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c617b953600/0x4d37c11031f363e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f363d9 expref: 17 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792079.841548:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c617b953600, rc 0) 00000100:00100000:0.0:1788792079.841627:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+17:22661:x1875683785821312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (11459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792079.841634:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788792079.841820:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785821312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788792079.841841:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f363e0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792079.841851:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f363e0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792079.841978:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785821440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788792079.842015:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792079.842046:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b3840 going to sleep for 11 seconds 00000100:00100000:0.0:1788792079.842245:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785821440 00000100:00100000:0.0:1788792079.842253:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785821440 00000100:00100000:0.0:1788792079.842290:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788792079.842298:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+17:22661:x1875683785821440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788792079.842410:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+17:22661:x1875683785821440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792079.842417:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788792079.842505:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785821440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788792079.842532:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785821568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788792079.842572:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792079.842788:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b3840 going to sleep for 11 seconds 00000100:00100000:0.0:1788792079.845039:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785821568 00000100:00100000:0.0:1788792079.845052:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785821568 00000100:00100000:0.0:1788792079.845983:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788792079.845998:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+17:22661:x1875683785821568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788792079.846172:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+17:22661:x1875683785821568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (3598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792079.846180:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788792079.846365:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785821568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788792079.847163:0:23867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788792079.847415:0:22661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788792079.847442:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788792079.847455:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f363e0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792079.847466:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f363e0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788792079.847477:0:22661:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788792079.847480:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c617fa8f000 from 13 10000000:01000000:1.0:1788792079.847482:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788792079.847517:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792079.847526:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792079.847535:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792079.847559:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785821696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788792079.847612:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792079.848170:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6174ce2180 going to sleep for 11 seconds 00000100:00100000:3.0:1788792079.848301:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785821696 00000100:00100000:3.0:1788792079.848310:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785821696 00000100:00100000:3.0:1788792079.848347:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788792079.848355:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+17:22661:x1875683785821696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788792079.848367:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792079.848381:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6181362200/0x4d37c11031f363ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f363e7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792079.848403:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6181362200/0x4d37c11031f363ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f363e7 expref: 18 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792079.848413:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6181362200/0x4d37c11031f363ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f363e7 expref: 18 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792079.848422:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6181362200, rc 0) 00000100:00100000:3.0:1788792079.848471:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+18:22661:x1875683785821696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792079.848477:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788792079.848549:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785821696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788792079.848562:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f363ee expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792079.848571:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f363ee expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792079.848629:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785821824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788792079.848657:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792079.848684:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6174ce2180 going to sleep for 11 seconds 00000100:00100000:3.0:1788792079.848730:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785821824 00000100:00100000:3.0:1788792079.848734:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785821824 00000100:00100000:3.0:1788792079.848751:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788792079.848757:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+18:22661:x1875683785821824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788792079.848901:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+18:22661:x1875683785821824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792079.848908:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788792079.849030:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785821824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788792079.849056:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785821952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788792079.849094:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792079.849114:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6174ce2180 going to sleep for 11 seconds 00000100:00100000:3.0:1788792079.849213:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785821952 00000100:00100000:3.0:1788792079.849223:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785821952 00000100:00100000:3.0:1788792079.849241:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788792079.849248:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+18:22661:x1875683785821952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788792079.849332:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+18:22661:x1875683785821952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792079.849339:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788792079.849406:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785821952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788792079.864162:0:23868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788792079.865241:0:22661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788792079.865266:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788792079.865279:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f363ee expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792079.865290:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f363ee expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792080.409119:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788792080.919493:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792080.919500:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792080.919503:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792080.919505:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792080.919520:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792080.919523:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792080.919525:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792080.919528:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788792080.919557:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a140336d-9a80-41e1-97b0-93600c05b204:3644:1875683785822080:0@lo:400:kworker.0 00000100:00100000:3.0:1788792080.919630:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792080.919669:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875683785822592:0@lo:400:kworker.0 00000100:00100000:3.0:1788792080.919699:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792080.919724:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788792080.919730:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785822464:0@lo:400:kworker.0 00000100:00100000:3.0:1788792080.919755:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792080.919781:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785822208:0@lo:400:kworker.0 00000100:00100000:3.0:1788792080.919804:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792080.919838:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788792080.919844:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785822336:0@lo:400:kworker.0 00000100:00100000:3.0:1788792080.919895:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792080.919929:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785822080 00000100:00100000:3.0:1788792080.919936:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785822080 00000100:00100000:3.0:1788792080.919982:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788792080.919992:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+18:3644:x1875683785822080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792080.920035:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+18:3644:x1875683785822080:12345-0@lo:400:kworker.0 Request processed in 45us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792080.920040:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788792080.920066:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785822592 00000100:00100000:3.0:1788792080.920068:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785822592 00000100:00100000:3.0:1788792080.920084:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785822336 00000100:00100000:3.0:1788792080.920086:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785822336 00000100:00100000:3.0:1788792080.920093:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788792080.920096:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875683785822592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792080.920116:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875683785822592:12345-0@lo:400:kworker.0 Request processed in 20us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792080.920120:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788792080.920126:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788792080.920129:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785822336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792080.920144:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785822336:12345-0@lo:400:kworker.0 Request processed in 15us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792080.920148:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788792080.920157:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785822464 00000100:00100000:3.0:1788792080.920159:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785822464 00000100:00100000:3.0:1788792080.920187:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785822208 00000100:00100000:3.0:1788792080.920191:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785822208 00000100:00100000:3.0:1788792080.920217:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788792080.920223:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785822464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792080.920255:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785822464:12345-0@lo:400:kworker.0 Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792080.920261:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788792080.920272:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788792080.920277:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875683785822208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792080.920300:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875683785822208:12345-0@lo:400:kworker.0 Request processed in 24us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792080.920305:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788792080.920347:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785822464:0@lo:400:kworker.0 00000100:00100000:3.0:1788792080.920356:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a140336d-9a80-41e1-97b0-93600c05b204:3644:1875683785822080:0@lo:400:kworker.0 00010000:00080000:3.0:1788792080.920368:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c6151f4ea00 x1875683785822592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792080.920378:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875683785822592:0@lo:400:kworker.0 00010000:00080000:3.0:1788792080.920410:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c6151f4fb80 x1875683785822336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792080.920418:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785822336:0@lo:400:kworker.0 00000100:00100000:3.0:1788792080.920427:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785822208:0@lo:400:kworker.0 00000100:00100000:3.0:1788792080.921241:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785822720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788792080.921281:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792080.921317:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785822720 00000100:00100000:3.0:1788792080.921322:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785822720 00000100:00100000:3.0:1788792080.921360:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788792080.921366:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785822720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788792080.921393:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788792080.921430:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785822720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792080.921436:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788792080.922320:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785822720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788792080.922750:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788792080.922770:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785822848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788792080.922816:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792080.922855:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785822848 00000100:00100000:2.0:1788792080.922862:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785822848 00000100:00100000:2.0:1788792080.923076:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788792080.923084:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875683785822848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788792080.923110:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788792080.923157:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875683785822848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792080.923163:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788792080.923190:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785822848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788792080.981969:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788792070/real 1788792070] req@ffff8c6043d16680 x1875683785816192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792080 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792080.981999:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c6043d16680 x1875683785816192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792080 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792080.982008:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788792070/real 1788792070] req@ffff8c6043dca680 x1875683785816064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792080 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792080.982019:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c6043dca680 x1875683785816064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792080 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792080.982027:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788792065/real 1788792065] req@ffff8c6043d14700 x1875683785814144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792080 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792080.982037:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c6043d14700 x1875683785814144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792080 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792080.982045:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788792065/real 1788792065] req@ffff8c6043d17100 x1875683785814272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792080 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792080.982054:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c6043d17100 x1875683785814272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792080 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788792080.982079:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6043e91000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788792080.982106:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788792080.982111:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785816192:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788792080.982117:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c617c331000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788792080.982123:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788792080.982127:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785816064:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788792080.982131:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6174caa000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788792080.982135:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788792080.982137:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785814144:0@lo:8:kworker.0 00000100:00080000:3.0:1788792080.982141:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6043732000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788792080.982145:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788792080.982147:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785814272:0@lo:8:kworker.0 00000100:00080000:1.0:1788792080.982233:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792080.982238:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788792080.982241:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c6174caa000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788792080.982246:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 708 00000100:00080000:1.0:1788792080.982250:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788792080.982257:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c6174caa000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792080.982287:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d15880 x1875683785822976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788792080.982312:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792080.982322:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788792080.982323:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c6043732000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788792080.982327:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 708 00000100:00080000:1.0:1788792080.982330:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788792080.982333:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c6043732000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792080.982346:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d16d80 x1875683785823104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788792080.982356:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792080.982359:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788792080.982360:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c617c331000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788792080.982363:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 713 00000100:00080000:1.0:1788792080.982365:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788792080.982368:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c617c331000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792080.982378:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d14000 x1875683785823232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788792080.982386:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792080.982389:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788792080.982391:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c6043e91000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788792080.982394:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 713 00000100:00080000:1.0:1788792080.982396:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788792080.982399:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c6043e91000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792080.982408:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d17800 x1875683785823360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788792080.982714:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785822976:0@lo:8:kworker.0 00000400:00000100:3.0:1788792080.982767:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683785822976 offset 0 length 520: 4 00000100:00100000:3.0:1788792080.982802:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785823104:0@lo:8:kworker.0 00000400:00000100:3.0:1788792080.982819:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683785823104 offset 0 length 520: 4 00000100:00100000:3.0:1788792080.982830:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785823232:0@lo:8:kworker.0 00000400:00000100:3.0:1788792080.982847:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683785823232 offset 0 length 520: 4 00000100:00100000:3.0:1788792080.982857:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785823360:0@lo:8:kworker.0 00000400:00000100:3.0:1788792080.982896:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683785823360 offset 0 length 520: 4 00010000:00010000:3.0:1788792081.431349:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788792081.944773:0:23397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:3.0:1788792082.007943:0:23423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788792082.454110:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792083.483905:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792084.512697:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792085.526988:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788792085.712183:0:24165:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788792085.712190:0:24165:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788792085.712191:0:24165:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788792085.712625:0:24165:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c614f2f0000 00000020:01000004:1.0:1788792085.712638:0:24165:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788792085.712650:0:24165:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788792085.712712:0:24165:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8c6150e23370) 00000020:00000080:1.0:1788792085.712728:0:24165:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788792085.748498:0:24165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788792085.750448:0:24165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788792085.750742:0:24165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788792085.750928:0:24165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788792085.751122:0:24165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788792085.751329:0:24165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788792085.751591:0:24165:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788792085.753193:0:24165:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788792085.753443:0:24165:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788792085.753454:0:24165:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788792085.753465:0:24165:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4d37c11031f363fc 00000020:01000004:2.0:1788792085.753471:0:24165:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788792085.753490:0:24165:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788792085.753493:0:24165:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788792085.753498:0:24165:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788792085.753501:0:24165:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788792085.753511:0:24165:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8c6175c40000) 00000020:00000080:2.0:1788792085.753519:0:24165:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788792085.756032:0:24165:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788792085.756207:0:24165:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788792085.756213:0:24165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788792085.760992:0:24165:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788792085.761001:0:24165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788792085.761345:0:24165:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788792085.761350:0:24165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788792085.762630:0:24165:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788792085.762834:0:24165:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788792085.762838:0:24165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788792085.764274:0:24165:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788792085.764285:0:24165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788792085.783480:0:24165:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788792085.784125:0:24165:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788792085.784132:0:24165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788792085.785784:0:24165:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788792085.785795:0:24165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788792085.787201:0:24165:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788792085.787275:0:24165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788792085.790478:0:24165:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788792085.790754:0:24165:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788792085.790762:0:24165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788792085.791564:0:24165:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788792085.791572:0:24165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788792085.819454:0:24165:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788792085.819643:0:24165:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788792085.819649:0:24165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788792085.820573:0:24165:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788792085.820580:0:24165:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788792085.820992:0:24165:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788792085.821020:0:24165:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788792085.821026:0:24165:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788792085.829724:0:24165:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788792085.829777:0:24165:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788792085.829782:0:24165:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788792085.829783:0:24165:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788792085.829784:0:24165:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788792085.829785:0:24165:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788792085.829786:0:24165:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788792085.829787:0:24165:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788792085.829788:0:24165:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788792085.829789:0:24165:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788792085.829790:0:24165:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788792085.829793:0:24165:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788792085.829795:0:24165:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788792085.829795:0:24165:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788792085.829796:0:24165:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788792085.829797:0:24165:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788792085.829800:0:24165:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788792085.829801:0:24165:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788792085.829801:0:24165:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788792085.829802:0:24165:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788792085.829803:0:24165:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788792085.829826:0:24165:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788792085.829842:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785823488:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788792085.830044:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792085.830145:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6043053240 going to sleep for 11 seconds 00000100:00100000:2.0:1788792085.830270:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785823488 00000100:00100000:2.0:1788792085.830277:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785823488 00000100:00100000:2.0:1788792085.830351:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788792085.830359:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+18:24165:x1875683785823488:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788792085.830394:0:22658:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788792085.830397:0:22658:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788792085.830400:0:22658:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788792085.830618:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+18:24165:x1875683785823488:12345-0@lo:253:mount.lustre.0 Request processed in 259us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792085.830626:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788792085.830663:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785823488:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788792085.830676:0:24165:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788792085.830679:0:24165:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788792085.830681:0:24165:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788792085.830682:0:24165:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788792085.830683:0:24165:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788792085.830684:0:24165:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788792085.830685:0:24165:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788792085.830686:0:24165:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788792085.830688:0:24165:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788792085.830689:0:24165:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788792085.830712:0:24165:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c614f2f0000 from lustre-OST0000 10000000:01000000:0.0:1788792085.830745:0:24165:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788792085.830749:0:24165:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788792085.830760:0:24165:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c604218b370 local copy 00010000:00010000:0.0:1788792085.830771:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361be expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792085.830895:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785823616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788792085.830928:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792085.830962:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6043656240 going to sleep for 11 seconds 00000100:00100000:2.0:1788792085.830971:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785823616 00000100:00100000:2.0:1788792085.830976:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785823616 00000100:00100000:2.0:1788792085.831029:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788792085.831038:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+18:24165:x1875683785823616:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788792085.831153:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+18:24165:x1875683785823616:12345-0@lo:501:mount.lustre.0 Request processed in 115us (222us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788792085.831160:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788792085.831293:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785823616:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788792085.831305:0:24165:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788792085.831318:0:24165:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788792085.831323:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361be expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792085.831329:0:24165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361be expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792085.831348:0:24165:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c614f2f0000 10000000:01000000:0.0:1788792085.831351:0:24165:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788792085.831354:0:24165:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788792085.831356:0:24165:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788792085.831359:0:24165:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788792085.831361:0:24165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788792085.831378:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b952200/0x4d37c11031f3640a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792085.831383:0:24165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c617b952200/0x4d37c11031f3640a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792085.831390:0:24165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c617b952200/0x4d37c11031f3640a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792085.831406:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785823744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788792085.831424:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792085.831469:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6043656240 going to sleep for 11 seconds 00000100:00100000:2.0:1788792085.831497:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785823744 00000100:00100000:2.0:1788792085.831501:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785823744 00000100:00100000:2.0:1788792085.831522:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788792085.831529:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+18:24165:x1875683785823744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788792085.831596:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792085.831609:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6140031e00/0x4d37c11031f36411 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f3640a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792085.831630:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6140031e00/0x4d37c11031f36411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f3640a expref: 19 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792085.831641:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6140031e00/0x4d37c11031f36411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f3640a expref: 19 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792085.831710:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140031e00, rc 0) 00000100:00100000:2.0:1788792085.831744:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+19:24165:x1875683785823744:12345-0@lo:101:mount.lustre.0 Request processed in 212us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792085.831751:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788792085.831775:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785823744:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788792085.831787:0:24165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c617b952200/0x4d37c11031f3640a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36411 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792085.831797:0:24165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c617b952200/0x4d37c11031f3640a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f36411 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788792085.832512:0:24165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1788792085.832960:0:24165:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788792085.834134:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788792085.834166:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788792085.834174:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788792085.834181:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788792085.834189:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788792085.834197:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788792085.834204:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788792085.834213:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788792085.834226:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1788792085.834241:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1788792085.834253:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1788792085.834267:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1788792085.834286:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1788792085.834289:0:24165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1788792085.834366:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785823872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788792085.834420:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792085.834465:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6143952480 going to sleep for 11 seconds 00000100:00100000:2.0:1788792085.834483:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785823872 00000100:00100000:2.0:1788792085.834491:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785823872 00000100:00100000:2.0:1788792085.834546:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788792085.834554:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604316a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+19:24165:x1875683785823872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788792085.834686:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604316a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+19:24165:x1875683785823872:12345-0@lo:501:mount.lustre.0 Request processed in 132us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792085.834694:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788792085.834711:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785823872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788792085.834741:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788792085.834778:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792085.834797:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6143952480 going to sleep for 11 seconds 00000100:00100000:2.0:1788792085.834929:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785824000 00000100:00100000:2.0:1788792085.834933:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785824000 00000100:00100000:2.0:1788792085.834957:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788792085.834963:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604316ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+19:24165:x1875683785824000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788792085.838687:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604316ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+19:24165:x1875683785824000:12345-0@lo:503:mount.lustre.0 Request processed in 3715us (3900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792085.838701:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788792085.838934:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824000:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788792085.839400:0:24165:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788792085.839464:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792085.839507:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792085.839542:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6150f9af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788792085.839554:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785824128 00000100:00100000:3.0:1788792085.839561:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785824128 00000100:00100000:3.0:1788792085.839602:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788792085.839611:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604316b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+19:24165:x1875683785824128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788792085.840002:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604316b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+19:24165:x1875683785824128:12345-0@lo:502:mount.lustre.0 Request processed in 392us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792085.840011:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788792085.840025:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788792085.840179:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788792085.840198:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788792085.840208:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788792085.840221:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788792085.840235:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788792085.840247:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788792085.840259:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788792085.840273:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788792085.840287:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788792085.840300:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788792085.840313:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788792085.840326:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788792085.840349:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792085.840383:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792085.840403:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6043656240 going to sleep for 11 seconds 00000100:00100000:2.0:1788792085.840410:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785824256 00000100:00100000:2.0:1788792085.840415:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785824256 00000100:00100000:2.0:1788792085.840442:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788792085.840449:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+19:24165:x1875683785824256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788792085.840519:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+19:24165:x1875683785824256:12345-0@lo:502:mount.lustre.0 Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792085.840526:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788792085.840537:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788792085.840573:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1788792085.840581:0:24165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788792085.841022:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788792085.841031:0:24182:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788792085.841037:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788792085.841039:0:24182:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788792085.841045:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788792085.841059:0:24182:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8c60433e3370) 00000020:00000080:0.0:1788792085.841080:0:24182:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788792085.841100:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788792085.841174:0:24182:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c614f2f0000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788792085.841183:0:24182:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788792085.841190:0:24182:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4d37c11031f3641f 00010000:00010000:0.0:1788792085.843658:0:24182:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788792085.844308:0:24182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1788792085.845365:0:24182:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788792085.846918:0:24182:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788792085.846931:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788792085.846938:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792085.846941:0:24182:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788792085.846945:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788792085.846948:0:24182:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788792085.846950:0:24182:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788792085.846952:0:24182:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788792085.846953:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788792085.846956:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792085.846957:0:24182:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788792085.846960:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788792085.846963:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792085.846965:0:24182:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788792085.846967:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788792085.846969:0:24182:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788792085.846971:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788792085.846979:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792085.846980:0:24182:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788792085.846983:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788792085.846986:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792085.846987:0:24182:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788792085.846990:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788792085.847032:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788792085.847035:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788792085.847037:0:24182:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788792085.847039:0:24182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1788792085.848395:0:24165:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788792085.848430:0:24165:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788792085.848453:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b952200/0x4d37c11031f3640a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36411 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792085.848468:0:24165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c617b952200/0x4d37c11031f3640a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36411 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792085.848477:0:24165:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c614f2f0000 from 1 10000000:01000000:0.0:1788792085.848480:0:24165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788792085.848531:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792085.848540:0:24165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792085.848563:0:24165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792085.848596:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788792085.848690:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792085.848746:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6150914a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788792085.848951:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785824384 00000100:00100000:2.0:1788792085.848961:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785824384 00000100:00100000:2.0:1788792085.849008:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788792085.849020:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+19:24165:x1875683785824384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788792085.849034:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792085.849051:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6140030e00/0x4d37c11031f3642d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f36426 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792085.849077:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6140030e00/0x4d37c11031f3642d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f36426 expref: 20 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792085.849105:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6140030e00/0x4d37c11031f3642d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36426 expref: 20 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792085.849115:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140030e00, rc 0) 00000100:00100000:2.0:1788792085.849159:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+20:24165:x1875683785824384:12345-0@lo:101:mount.lustre.0 Request processed in 141us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792085.849166:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788792085.849283:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788792085.849298:0:24165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3642d expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792085.849308:0:24165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f3642d expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788792085.851107:0:24165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788792085.851413:0:24165:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788792085.851600:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788792085.851625:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788792085.851639:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788792085.851650:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788792085.851677:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788792085.851703:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788792085.851715:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788792085.851725:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788792085.851736:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788792085.851745:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788792085.851755:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788792085.851770:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788792085.851774:0:24165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788792085.851842:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788792085.851937:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792085.851980:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6150914240 going to sleep for 11 seconds 00000100:00100000:2.0:1788792085.852278:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785824512 00000100:00100000:2.0:1788792085.852286:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785824512 00000100:00100000:2.0:1788792085.852368:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788792085.852378:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+20:24165:x1875683785824512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788792085.852504:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+20:24165:x1875683785824512:12345-0@lo:501:mount.lustre.0 Request processed in 127us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792085.852511:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788792085.852594:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788792085.852635:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788792085.852682:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792085.852853:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6174ce2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788792085.853225:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785824640 00000100:00100000:0.0:1788792085.853231:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785824640 00000100:00100000:0.0:1788792085.853257:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788792085.853264:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+20:24165:x1875683785824640:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788792085.853347:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+20:24165:x1875683785824640:12345-0@lo:503:mount.lustre.0 Request processed in 82us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792085.853354:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788792085.853373:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824640:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788792085.853820:0:24165:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788792085.853909:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788792085.853949:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792085.853978:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6174ce2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788792085.853978:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785824768 00000100:00100000:0.0:1788792085.853983:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785824768 00000100:00100000:0.0:1788792085.854028:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788792085.854035:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+20:24165:x1875683785824768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792085.854134:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+20:24165:x1875683785824768:12345-0@lo:502:mount.lustre.0 Request processed in 99us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792085.854141:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788792085.854184:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788792085.854357:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788792085.854377:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788792085.854384:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788792085.854391:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788792085.854398:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788792085.854405:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788792085.854412:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788792085.854419:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788792085.854426:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788792085.854442:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788792085.854450:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788792085.854464:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788792085.854492:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792085.854514:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6174ce2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788792085.854540:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785824896 00000100:00100000:2.0:1788792085.854545:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785824896 00000100:00100000:2.0:1788792085.854579:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788792085.854586:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+20:24165:x1875683785824896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788792085.854664:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+20:24165:x1875683785824896:12345-0@lo:502:mount.lustre.0 Request processed in 78us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792085.854670:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788792085.854737:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785824896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788792085.854764:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788792085.854768:0:24165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788792085.855297:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788792085.855304:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792085.855306:0:24186:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788792085.855310:0:24186:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c614f2f0000 00000020:00000080:1.0:1788792085.855312:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788792085.855318:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792085.855320:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792085.855321:0:24186:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788792085.855323:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788792085.855324:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792085.855325:0:24186:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788792085.855327:0:24186:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c614f2f0000 00000020:00000080:1.0:1788792085.855328:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788792085.855372:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792085.855380:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792085.855381:0:24186:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788792085.855383:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788792085.855385:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792085.855386:0:24186:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788792085.855390:0:24186:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c614f2f0000 00000020:00000080:1.0:1788792085.855392:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788792085.855408:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792085.855411:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792085.855412:0:24186:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788792085.855414:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788792085.855416:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792085.855417:0:24186:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788792085.855428:0:24186:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c614f2f0000 00000020:00000080:1.0:1788792085.855430:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788792085.855450:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792085.855453:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792085.855454:0:24186:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788792085.855456:0:24186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788792085.855647:0:24165:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788792085.855733:0:24165:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788792085.855786:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3642d expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792085.855798:0:24165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3642d expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792085.855847:0:24165:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788792085.855851:0:24165:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c614f2f0000 10000000:01000000:0.0:1788792085.855854:0:24165:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c614f2f0000 10000000:01000000:0.0:1788792085.855858:0:24165:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788792085.855868:0:24165:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c614f2f0000 from 1 10000000:01000000:0.0:1788792085.855892:0:24165:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788792085.855921:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953400/0x4d37c11031f36434 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792085.855930:0:24165:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c617b953400/0x4d37c11031f36434 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792085.855939:0:24165:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c617b953400/0x4d37c11031f36434 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792085.855955:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785825024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788792085.855991:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792085.856025:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6150914240 going to sleep for 11 seconds 00000100:00100000:3.0:1788792085.858633:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785825024 00000100:00100000:3.0:1788792085.858646:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785825024 00000100:00100000:3.0:1788792085.858708:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788792085.858720:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+20:24165:x1875683785825024:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788792085.858738:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792085.858757:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6181362000/0x4d37c11031f3643b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f36434 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792085.858783:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6181362000/0x4d37c11031f3643b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f36434 expref: 21 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792085.858794:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6181362000/0x4d37c11031f3643b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36434 expref: 21 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792085.858804:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6181362000, rc 0) 00000100:00100000:3.0:1788792085.858891:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:24165:x1875683785825024:12345-0@lo:101:mount.lustre.0 Request processed in 155us (2880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792085.858899:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788792085.859275:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785825024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788792085.859296:0:24165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c617b953400/0x4d37c11031f36434 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3643b expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792085.859306:0:24165:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c617b953400/0x4d37c11031f36434 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f3643b expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788792085.863295:0:24165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788792085.863644:0:24165:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788792085.863897:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788792085.863922:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788792085.863935:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788792085.863947:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788792085.863960:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788792085.863971:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788792085.863982:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788792085.864009:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788792085.864024:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788792085.864037:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788792085.864049:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788792085.864061:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788792085.864074:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788792085.864165:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788792085.864181:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788792085.864192:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788792085.864202:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788792085.864213:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788792085.864225:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788792085.864237:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788792085.864248:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788792085.864260:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788792085.864271:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788792085.864297:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788792085.864313:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788792085.864335:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788792085.864349:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788792085.864363:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788792085.864374:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788792085.864386:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788792085.864398:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788792085.864409:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788792085.864422:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788792085.864448:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788792085.864463:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788792085.864476:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788792085.864489:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788792085.864639:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788792085.864665:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788792085.864691:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788792085.864704:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788792085.864716:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788792085.864727:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788792085.864739:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788792085.864751:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788792085.864763:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788792085.864776:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788792085.864788:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1788792085.864910:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788792085.864931:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788792085.864948:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788792085.864953:0:24165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788792085.865031:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785825152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788792085.865227:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792085.865274:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788792085.865934:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785825152 00000100:00100000:1.0:1788792085.865942:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785825152 00000100:00100000:1.0:1788792085.865996:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788792085.866005:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+21:24165:x1875683785825152:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788792085.866262:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+21:24165:x1875683785825152:12345-0@lo:501:mount.lustre.0 Request processed in 257us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792085.866301:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785825152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788792085.866342:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785825280:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788792085.866385:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792085.866409:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6043656000 going to sleep for 11 seconds 00000100:00100000:1.0:1788792085.866443:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788792085.866468:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785825280 00000100:00100000:1.0:1788792085.866472:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785825280 00000100:00100000:1.0:1788792085.866543:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788792085.866550:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+21:24165:x1875683785825280:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788792085.866625:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+21:24165:x1875683785825280:12345-0@lo:503:mount.lustre.0 Request processed in 75us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792085.866632:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788792085.866710:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785825280:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788792085.867265:0:24165:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788792085.867332:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785825408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792085.867365:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792085.867389:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785825408 00000100:00100000:0.0:1788792085.867393:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785825408 00000100:00100000:0.0:1788792085.867415:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788792085.867422:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:24165:x1875683785825408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792085.867493:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:24165:x1875683785825408:12345-0@lo:502:mount.lustre.0 Request processed in 71us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792085.867500:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788792085.867548:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61469bb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788792085.867561:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785825408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788792085.867701:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788792085.867723:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788792085.867737:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788792085.867749:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788792085.867760:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788792085.867773:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788792085.867785:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788792085.867798:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788792085.867824:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788792085.867839:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788792085.867854:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788792085.867866:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788792085.867901:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788792085.867916:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788792085.867929:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788792085.867942:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788792085.867955:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788792085.867967:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788792085.867990:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788792085.868002:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788792085.868016:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788792085.868029:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788792085.868042:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788792085.868054:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788792085.868095:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788792085.868114:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788792085.868127:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788792085.868140:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788792085.868154:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788792085.868168:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788792085.868182:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788792085.868194:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788792085.868207:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788792085.868221:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788792085.868234:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788792085.868249:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788792085.868263:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788792085.868277:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788792085.868290:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788792085.868301:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788792085.868326:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788792085.868341:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788792085.868353:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788792085.868365:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788792085.868378:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788792085.868391:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788792085.868404:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788792085.868416:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788792085.868449:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785825536:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792085.868491:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792085.868531:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785825536 00000100:00100000:0.0:1788792085.868535:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785825536 00000100:00100000:0.0:1788792085.868558:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788792085.868564:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:24165:x1875683785825536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792085.868638:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:24165:x1875683785825536:12345-0@lo:502:mount.lustre.0 Request processed in 74us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792085.868646:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788792085.868686:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61469bb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788792085.868700:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785825536:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788792085.868812:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788792085.868832:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788792085.868851:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785825664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792085.868943:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792085.868964:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785825664 00000100:00100000:0.0:1788792085.868968:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785825664 00000100:00100000:0.0:1788792085.868986:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788792085.868991:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:24165:x1875683785825664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792085.869047:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:24165:x1875683785825664:12345-0@lo:502:mount.lustre.0 Request processed in 55us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792085.869054:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788792085.869099:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6143952d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788792085.869112:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785825664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788792085.869145:0:24165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788792085.869151:0:24165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788792085.870812:0:24191:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788792085.870828:0:24191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c6150e20000) 00000020:00000080:1.0:1788792085.870852:0:24191:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788792085.871005:0:24191:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c614f2f0000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788792085.871009:0:24191:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c614f2f0000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788792085.871012:0:24191:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c614f2f0000 3 00010000:00080000:1.0:1788792085.871042:0:24191:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c6174eac000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788792085.876859:0:24191:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788792085.877434:0:24191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788792085.877491:0:24191:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788792085.877508:0:24191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4d37c11031f36449 00000100:00080000:1.0:1788792085.877521:0:24191:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788792085.877603:0:24191:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c6174eac000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792085.877642:0:24191:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d14e00 x1875683785825792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788792085.877753:0:24191:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788792085.877921:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875683785825792:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788792085.878000:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788792085.878485:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792085.878491:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792085.878498:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792085.878501:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792085.878529:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792085.878532:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792085.878535:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792085.878538:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788792085.878571:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785825792 00000100:00100000:3.0:1788792085.878579:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785825792 00000100:00100000:3.0:1788792085.878616:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788792085.878623:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785825920:0@lo:400:kworker.0 00000100:00100000:3.0:1788792085.878625:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875683785825792:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788792085.878650:0:22665:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 728 last 0 00000020:00000080:3.0:1788792085.878685:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4d37c11031f36450 00000004:00100000:3.0:1788792085.878701:0:22665:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788792085.878733:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788792085.878736:0:22665:0:(import.c:65:import_set_state_nolock()) ffff8c614f311800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788792085.878757:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788792085.878763:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875683785826048:0@lo:400:kworker.0 00000100:00100000:3.0:1788792085.878789:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875683785825792:12345-0@lo:38:llog_process_th.0 Request processed in 163us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792085.878796:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788792085.878798:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792085.878814:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785826048 00000100:00100000:3.0:1788792085.878817:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785826048 00000100:00100000:3.0:1788792085.878841:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788792085.878847:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875683785826048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792085.879095:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875683785826048:12345-0@lo:400:kworker.0 Request processed in 234us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792085.879102:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788792085.879139:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785826176:0@lo:400:kworker.0 00000100:00100000:3.0:1788792085.879166:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792085.879184:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788792085.879190:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875683785826304:0@lo:400:kworker.0 00010000:00080000:1.0:1788792085.879206:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c6151f4c000 x1875683785826048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792085.879220:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875683785826048:0@lo:400:kworker.0 00000100:00100000:3.0:1788792085.879273:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792085.879320:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785826304 00000100:00100000:3.0:1788792085.879325:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785826304 00000100:00100000:3.0:1788792085.879343:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788792085.879349:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875683785826304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792085.879386:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875683785826304:12345-0@lo:400:kworker.0 Request processed in 37us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792085.879392:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788792085.879414:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785825920 00000100:00100000:3.0:1788792085.879419:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785825920 00000100:00100000:3.0:1788792085.879446:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785826176 00000100:00100000:3.0:1788792085.879450:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785826176 00000100:00100000:3.0:1788792085.879465:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788792085.879471:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785825920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792085.879519:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785825920:12345-0@lo:400:kworker.0 Request processed in 48us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792085.879524:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788792085.879537:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788792085.879544:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785826176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792085.879570:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785826176:12345-0@lo:400:kworker.0 Request processed in 27us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792085.879576:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788792085.879610:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c6151f4f480 x1875683785826304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792085.879626:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875683785826304:0@lo:400:kworker.0 00000100:00100000:1.0:1788792085.879627:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785825920:0@lo:400:kworker.0 00000100:00100000:3.0:1788792085.879635:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785826176:0@lo:400:kworker.0 00010000:00080000:3.0:1788792085.879665:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c6043d14e00 x1875683785825792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788792095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792085.879674:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788792085.879681:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788792085.879689:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788792085.879694:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788792085.879696:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6174eac000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788792085.879703:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875683785825792:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1788792085.883461:0:24191:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788792085.883480:0:24191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8c60424a8000) 00000020:00000080:1.0:1788792085.883507:0:24191:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788792085.883618:0:24191:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c614f2f0000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788792085.883624:0:24191:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c614f2f0000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788792085.883627:0:24191:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c614f2f0000 3 00010000:00080000:1.0:1788792085.883670:0:24191:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c6042335800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788792085.885786:0:24191:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788792085.886182:0:24191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788792085.886247:0:24191:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788792085.886262:0:24191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4d37c11031f3645e 00000100:00080000:1.0:1788792085.886273:0:24191:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788792085.886279:0:24191:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8c6042335800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792085.886323:0:24191:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d14700 x1875683785826432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788792085.886361:0:24191:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1788792085.886860:0:24191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1788792085.886940:0:24165:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788792085.886972:0:24165:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788792085.887033:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c617b953400/0x4d37c11031f36434 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3643b expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792085.887045:0:24165:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c617b953400/0x4d37c11031f36434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3643b expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788792085.887111:0:24165:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788792085.887113:0:24165:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788792085.887114:0:24165:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788792085.887116:0:24165:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788792085.887117:0:24165:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788792085.887118:0:24165:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788792085.887120:0:24165:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788792085.887122:0:24165:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788792085.887123:0:24165:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788792085.887128:0:24165:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788792085.887130:0:24165:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788792085.887131:0:24165:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788792085.887133:0:24165:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788792085.887134:0:24165:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788792085.887135:0:24165:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788792085.887136:0:24165:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788792085.887137:0:24165:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788792085.887138:0:24165:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788792085.887139:0:24165:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788792085.887157:0:24165:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788792085.887176:0:24165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785826560:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788792085.887268:0:24165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792085.887308:0:24165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6150914a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788792085.887329:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785826560 00000100:00100000:0.0:1788792085.887337:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785826560 00000100:00100000:0.0:1788792085.887388:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788792085.887398:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:24165:x1875683785826560:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788792085.887431:0:22659:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788792085.887443:0:22659:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788792085.887531:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875683785826432:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788792085.887573:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788792085.887606:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792085.887610:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792085.887613:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792085.887616:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792085.887620:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792085.887623:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792085.887627:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792085.887630:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788792085.887650:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785826432 00000100:00100000:3.0:1788792085.887659:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785826432 00000100:00100000:3.0:1788792085.887686:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788792085.887691:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875683785826432:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788792085.887712:0:22666:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 728 last 0 00000020:00000080:3.0:1788792085.887759:0:22666:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4d37c11031f36465 00000004:00100000:3.0:1788792085.887773:0:22666:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788792085.887809:0:22666:0:(import.c:65:import_set_state_nolock()) ffff8c614f310000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788792085.887858:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875683785826432:12345-0@lo:38:llog_process_th.0 Request processed in 165us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792085.887865:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788792085.888163:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c6043d14700 x1875683785826432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788792095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792085.888174:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788792085.888184:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788792085.888191:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788792085.888196:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788792085.888198:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6042335800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788792085.888203:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875683785826432:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788792085.889641:0:22659:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788792085.889662:0:22659:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788792085.889761:0:22680:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788792085.889766:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788792085.889788:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792085.889807:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c6140030a00/0x4d37c11031f363b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f363af expref: 21 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792085.889815:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c617b952c00/0x4d37c11031f363c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f363bd expref: 21 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792085.889830:0:22680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792085.889866:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c617b952c00/0x4d37c11031f363c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4d37c11031f363bd expref: 21 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792085.889903:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c617b952c00/0x4d37c11031f363c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4d37c11031f363bd expref: 21 pid: 22657 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792085.889917:0:22680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c48700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875683785826688:0@lo:104: 00000100:00100000:3.0:1788792085.889973:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792085.890408:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785826688 00000100:00100000:2.0:1788792085.890416:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785826688 00000100:00100000:2.0:1788792085.890483:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788792085.890492:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a140336d-9a80-41e1-97b0-93600c05b204+3:22680:x1875683785826688:12345-0@lo:104: 00010000:00010000:2.0:1788792085.890507:0:22647:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f363c4 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792085.890560:0:22647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788792085.890567:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a140336d-9a80-41e1-97b0-93600c05b204+3:22680:x1875683785826688:12345-0@lo:104: Request processed in 76us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792085.890574:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788792085.890698:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788792085.890705:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f363c4 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792085.890714:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b953000 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:2.0:1788792085.890718:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4d37c11031f363c4 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792085.890727:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4d37c11031f363c4 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788792085.890734:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4d37c11031f363c4 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788792085.890749:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788792085.890785:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f363c4 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792085.890791:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788792085.890813:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f363c4 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792085.890820:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c617b953000/0x4d37c11031f363bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f363c4 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792085.890830:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792085.890832:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792085.890834:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788792085.890846:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785826816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788792085.890891:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792085.890926:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785826816 00000100:00100000:2.0:1788792085.890930:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785826816 00010000:00010000:2.0:1788792085.890949:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c617b952c00/0x4d37c11031f363c4 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f363bd expref: 22 pid: 22657 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792085.890977:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788792085.890984:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043708000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a140336d-9a80-41e1-97b0-93600c05b204+22:3643:x1875683785826816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788792085.890994:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788792085.890999:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c617b952c00/0x4d37c11031f363c4 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f363bd expref: 22 pid: 22657 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792085.891315:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c617b952c00/0x4d37c11031f363c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4d37c11031f363bd expref: 22 pid: 22657 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792085.891367:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c6140030a00/0x4d37c11031f363b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4d37c11031f363af expref: 22 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792085.891380:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c6140030a00/0x4d37c11031f363b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4d37c11031f363af expref: 22 pid: 22658 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792085.891389:0:22680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c4aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875683785826944:0@lo:104: 00000100:00100000:3.0:1788792085.891419:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792085.891442:0:22680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6043053600 going to sleep for 11 seconds 00000100:00100000:3.0:1788792085.891462:0:22680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c48700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875683785826688:0@lo:104: 00010000:00010000:2.0:1788792085.893296:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c617b952c00/0x4d37c11031f363c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4d37c11031f363bd expref: 22 pid: 22657 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792085.893317:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788792085.893408:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043708000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a140336d-9a80-41e1-97b0-93600c05b204+21:3643:x1875683785826816:12345-0@lo:103:ldlm_bl.0 Request processed in 2422us (2514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792085.893420:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788792085.893422:0:22647:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788792085.893438:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785826944 00000100:00100000:0.0:1788792085.893446:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785826944 00000100:00100000:0.0:1788792085.893488:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788792085.893522:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a140336d-9a80-41e1-97b0-93600c05b204+3:22680:x1875683785826944:12345-0@lo:104: 00010000:00010000:0.0:1788792085.893615:0:22647:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f363b6 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792085.893747:0:22647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788792085.893753:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a140336d-9a80-41e1-97b0-93600c05b204+3:22680:x1875683785826944:12345-0@lo:104: Request processed in 234us (2334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792085.893759:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788792085.893840:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+20:24165:x1875683785826560:12345-0@lo:253:mount.lustre.0 Request processed in 6443us (6573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792085.893848:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788792085.893865:0:22680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c4aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875683785826944:0@lo:104: 00000100:00100000:0.0:1788792085.893914:0:24165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24165:1875683785826560:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788792085.893923:0:24165:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788792085.893926:0:24165:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788792085.893928:0:24165:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788792085.893929:0:24165:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:2.0:1788792085.893930:0:22680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788792085.893931:0:24165:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788792085.893932:0:24165:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788792085.893933:0:24165:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788792085.893935:0:24165:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788792085.893936:0:24165:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788792085.893938:0:24165:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788792085.893946:0:24165:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788792085.894145:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792085.894153:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f363b6 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.894162:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b953800 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:1.0:1788792085.894167:0:22652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4d37c11031f363b6 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.894176:0:22652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4d37c11031f363b6 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788792085.894183:0:22652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4d37c11031f363b6 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788792085.894188:0:22652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788792085.894228:0:22652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f363b6 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.894234:0:22652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788792085.894264:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f363b6 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.894271:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c617b953800/0x4d37c11031f363af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f363b6 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.894284:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792085.894286:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792085.894298:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788792085.894321:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785826816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788792085.894335:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788792085.894344:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785827072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788792085.894385:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792085.894433:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785827072 00000100:00100000:1.0:1788792085.894438:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785827072 00010000:00010000:1.0:1788792085.894455:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c6140030a00/0x4d37c11031f363b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f363af expref: 20 pid: 22658 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792085.894477:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788792085.894484:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614329cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a140336d-9a80-41e1-97b0-93600c05b204+20:3643:x1875683785827072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788792085.894494:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788792085.894499:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c6140030a00/0x4d37c11031f363b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f363af expref: 20 pid: 22658 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.894511:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c6140030a00/0x4d37c11031f363b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4d37c11031f363af expref: 20 pid: 22658 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.894523:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6140030a00/0x4d37c11031f363b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4d37c11031f363af expref: 20 pid: 22658 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.895183:0:22649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.895194:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788792085.895212:0:22649:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005445943s 00010000:00010000:1.0:1788792085.895217:0:22649:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.895231:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.895238:0:22649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.895244:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.895250:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6181362400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792085.895254:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.895262:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.895283:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792085.895294:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788792085.895346:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614329cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a140336d-9a80-41e1-97b0-93600c05b204+19:3643:x1875683785827072:12345-0@lo:103:ldlm_bl.0 Request processed in 861us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792085.895354:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788792085.895447:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785827072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788792085.895576:0:22680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792085.895584:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792085.895590:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6181362400/0x4d37c11031f3646c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788792085.896305:0:24165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788792085.898315:0:24165:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788792085.898324:0:24165:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788792085.898360:0:24165:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788792085.898397:0:24165:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788792085.898412:0:24165:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788792085.898433:0:24165:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788792085.899401:0:24165:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788792085.899597:0:24165:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788792086.051172:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785827200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788792086.051463:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792086.051624:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788792086.051634:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785827328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788792086.051662:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792086.053578:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785827200 00000100:00100000:1.0:1788792086.053593:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785827200 00000100:00100000:1.0:1788792086.053649:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785827328 00000100:00100000:1.0:1788792086.053652:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785827328 00000100:00100000:1.0:1788792086.053673:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788792086.053683:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785827200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788792086.053719:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788792086.053800:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785827200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (2338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792086.053808:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788792086.053826:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788792086.053832:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785827328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788792086.053849:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788792086.053897:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785827328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792086.053903:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788792086.053954:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785827328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788792086.053971:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785827200:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788792086.550430:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788792086.765970:0:24246:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788792086.773907:0:24246:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788792087.579519:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788792087.643798:0:22661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788792087.643805:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c617f976000 from 13 10000000:01000000:2.0:1788792087.643809:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788792087.643853:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792087.643862:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792087.643892:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792087.643913:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785827456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788792087.643969:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792087.644001:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c614f74c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788792087.644183:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785827456 00000100:00100000:1.0:1788792087.644192:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785827456 00000100:00100000:1.0:1788792087.644244:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788792087.644252:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+19:22661:x1875683785827456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788792087.644265:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788792087.644279:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6141688800/0x4d37c11031f3647a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f36473 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792087.644300:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6141688800/0x4d37c11031f3647a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f36473 expref: 20 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792087.644311:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6141688800/0x4d37c11031f3647a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36473 expref: 20 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792087.644318:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6141688800, rc 0) 00000100:00100000:1.0:1788792087.644372:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+20:22661:x1875683785827456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792087.644378:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788792087.644476:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785827456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788792087.644491:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3647a expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792087.644505:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f3647a expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792087.644544:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785827584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788792087.644675:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792087.644772:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785827584 00000100:00100000:2.0:1788792087.644783:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785827584 00000100:00100000:2.0:1788792087.644816:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788792087.644823:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+20:22661:x1875683785827584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788792087.644836:0:22659:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788792087.644853:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788792087.644856:0:22659:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788792087.651143:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+20:22661:x1875683785827584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 6309us (6455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792087.651816:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60430530c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788792087.651839:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785827584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788792087.651913:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788792087.651923:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3647a expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792087.651931:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3647a expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788792087.651939:0:22661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788792087.651947:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c617fa8f000 from 13 10000000:01000000:3.0:1788792087.651949:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788792087.651977:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792087.651983:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792087.651989:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792087.652003:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785827712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788792087.652034:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792087.652061:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60430530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788792087.652137:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788792087.652176:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785827712 00000100:00100000:2.0:1788792087.652183:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785827712 00000100:00100000:2.0:1788792087.652218:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788792087.652227:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+20:22661:x1875683785827712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788792087.652239:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792087.652250:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6140031200/0x4d37c11031f36488 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f36481 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792087.652272:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6140031200/0x4d37c11031f36488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f36481 expref: 21 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792087.652281:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6140031200/0x4d37c11031f36488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36481 expref: 21 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792087.652289:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140031200, rc 0) 00000100:00100000:2.0:1788792087.652322:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:22661:x1875683785827712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792087.652328:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788792087.652373:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785827712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788792087.653863:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36488 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792087.653898:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f36488 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792087.653961:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785827840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788792087.654016:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792087.654066:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c614f74c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788792087.654219:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785827840 00000100:00100000:3.0:1788792087.654228:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785827840 00000100:00100000:3.0:1788792087.654267:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788792087.654275:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:22661:x1875683785827840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788792087.654294:0:22659:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788792087.654310:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788792087.654313:0:22659:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788792087.654404:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:22661:x1875683785827840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792087.654412:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788792087.654483:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785827840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788792087.654556:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788792087.654563:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36488 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792087.654572:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36488 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788792087.959821:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788792088.602465:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792089.622452:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792090.650369:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788792091.158538:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792091.158552:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792091.158555:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792091.158584:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792091.158614:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792091.158618:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792091.158621:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792091.158623:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788792091.158684:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785828096:0@lo:400:kworker.0 00000100:00100000:3.0:1788792091.158805:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792091.158855:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875683785828608:0@lo:400:kworker.0 00000100:00100000:3.0:1788792091.158906:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792091.158939:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788792091.158946:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a140336d-9a80-41e1-97b0-93600c05b204:3644:1875683785827968:0@lo:400:kworker.0 00000100:00100000:3.0:1788792091.158981:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792091.159017:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875683785828480:0@lo:400:kworker.0 00000100:00100000:1.0:1788792091.159249:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785828224:0@lo:400:kworker.0 00000100:00100000:1.0:1788792091.159357:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785828992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788792091.159384:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792091.159425:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785828096 00000100:00100000:1.0:1788792091.159435:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785828096 00000100:00100000:1.0:1788792091.159484:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785828992 00000100:00100000:1.0:1788792091.159487:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785828992 00000100:00100000:1.0:1788792091.159503:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788792091.159514:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875683785828096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792091.159585:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875683785828096:12345-0@lo:400:kworker.0 Request processed in 71us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792091.159595:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788792091.159620:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788792091.159627:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785828992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788792091.159667:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788792091.159706:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785828992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792091.159714:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788792091.159780:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785828992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788792091.160410:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792091.160487:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785828096:0@lo:400:kworker.0 00000100:00100000:3.0:1788792091.160516:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785828352:0@lo:400:kworker.0 00000100:00100000:3.0:1788792091.160555:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792091.160574:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785828864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788792091.160595:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792091.160629:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785828352 00000100:00100000:3.0:1788792091.160635:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785828352 00000100:00100000:1.0:1788792091.161568:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785828608 00000100:00100000:1.0:1788792091.161576:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785828608 00000100:00100000:1.0:1788792091.161638:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785828480 00000100:00100000:1.0:1788792091.161667:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785828480 00000100:00100000:1.0:1788792091.161691:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788792091.161701:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875683785828608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792091.161786:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875683785828608:12345-0@lo:400:kworker.0 Request processed in 85us (2877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792091.161795:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788792091.161818:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788792091.161826:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875683785828480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792091.161857:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875683785828480:12345-0@lo:400:kworker.0 Request processed in 33us (2815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792091.161863:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788792091.161940:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788792091.162001:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043c49880 x1875683785828480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792091.162019:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875683785828480:0@lo:400:kworker.0 00010000:00080000:1.0:1788792091.162037:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043c48e00 x1875683785828608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792091.162056:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875683785828608:0@lo:400:kworker.0 00000100:00100000:3.0:1788792091.162608:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785828864 00000100:00100000:3.0:1788792091.162616:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785828864 00000100:00100000:3.0:1788792091.162651:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788792091.165467:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875683785828352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792091.165618:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875683785828352:12345-0@lo:400:kworker.0 Request processed in 183us (5061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792091.165626:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788792091.165667:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788792091.165675:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785828864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788792091.165707:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788792091.165741:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785828864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (5146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792091.165747:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788792091.165784:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785827968 00000100:00100000:3.0:1788792091.165792:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785827968 00000100:00100000:3.0:1788792091.165830:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788792091.165836:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+21:3644:x1875683785827968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792091.165869:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+21:3644:x1875683785827968:12345-0@lo:400:kworker.0 Request processed in 34us (6887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792091.165890:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788792091.165935:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792091.165974:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875683785828736:0@lo:400:kworker.0 00000100:00100000:3.0:1788792091.166022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792091.166061:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785828224 00000100:00100000:3.0:1788792091.166065:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785828224 00000100:00100000:3.0:1788792091.166092:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785828736 00000100:00100000:3.0:1788792091.166095:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785828736 00000100:00100000:3.0:1788792091.166119:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788792091.166125:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785828224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792091.166178:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785828224:12345-0@lo:400:kworker.0 Request processed in 54us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792091.166186:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788792091.166199:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788792091.166206:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875683785828736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792091.166232:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875683785828736:12345-0@lo:400:kworker.0 Request processed in 27us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792091.166238:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788792091.166283:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043c4a300 x1875683785828224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792091.166301:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785828224:0@lo:400:kworker.0 00010000:00080000:3.0:1788792091.166313:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043c4ad80 x1875683785828736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792091.166320:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875683785828736:0@lo:400:kworker.0 00000100:00080000:1.0:1788792091.167222:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788792091.167259:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785828352:0@lo:400:kworker.0 00000100:00100000:1.0:1788792091.167279:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785828864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788792091.167332:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a140336d-9a80-41e1-97b0-93600c05b204:3644:1875683785827968:0@lo:400:kworker.0 00010000:00010000:0.0:1788792091.677266:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788792092.248158:0:23423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1788792092.444023:0:24535:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788792092.700283:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788792093.667692:0:24588:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788792093.668056:0:24588:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788792093.722964:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792094.742400:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788792094.900530:0:24639:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788792094.901193:0:24639:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788792095.126057:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788792080/real 1788792080] req@ffff8c6043d14000 x1875683785823232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792095 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792095.126107:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c6043d14000 x1875683785823232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792095 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792095.126119:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788792080/real 1788792080] req@ffff8c6043d17800 x1875683785823360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792095 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792095.126131:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c6043d17800 x1875683785823360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792095 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788792095.126152:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c617c331000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788792095.126184:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788792095.126202:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785823232:0@lo:8:kworker.0 00000100:00080000:1.0:1788792095.126208:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6043e91000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788792095.126215:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788792095.126218:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785823360:0@lo:8:kworker.0 00000100:00080000:3.0:1788792095.126469:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792095.126475:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792095.126479:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792095.126481:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788792095.126500:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792095.126503:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788792095.126506:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c617c331000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788792095.126514:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 723 00000100:00080000:3.0:1788792095.126520:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788792095.126541:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c617c331000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788792095.126564:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043c48e00 x1875683785829632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788792095.126579:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788792095.126581:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788792095.126583:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c6043e91000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788792095.126586:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 723 00000100:00080000:3.0:1788792095.126589:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788792095.126593:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c6043e91000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788792095.126603:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043c49880 x1875683785829760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788792095.126654:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785829504:0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.126784:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792095.126818:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788792095.126824:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785829120:0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.126849:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792095.126908:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875683785829888:0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.126944:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792095.126971:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785829248:0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.126993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792095.127007:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875683785830016:0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.127024:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792095.127039:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788792095.127045:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785829376:0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.127291:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792095.127317:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875683785830144:0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.127340:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792095.127469:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785829504 00000100:00100000:3.0:1788792095.127478:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785829504 00000100:00100000:3.0:1788792095.127533:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785829248 00000100:00100000:3.0:1788792095.127536:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785829248 00000100:00100000:3.0:1788792095.127551:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788792095.127561:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785829504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.127642:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785829504:12345-0@lo:400:kworker.0 Request processed in 81us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792095.127650:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788792095.127668:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788792095.127674:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785829248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.127705:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785829248:12345-0@lo:400:kworker.0 Request processed in 31us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792095.127711:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788792095.127754:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785829120 00000100:00100000:3.0:1788792095.127758:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785829120 00000100:00100000:3.0:1788792095.127785:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788792095.127791:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+21:3643:x1875683785829120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.127819:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+21:3643:x1875683785829120:12345-0@lo:400:kworker.0 Request processed in 29us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792095.127824:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788792095.127901:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785829888 00000100:00100000:3.0:1788792095.127906:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785829888 00000100:00100000:3.0:1788792095.127944:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785830016 00000100:00100000:3.0:1788792095.127957:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785830016 00000100:00100000:3.0:1788792095.127986:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785829376 00000100:00100000:3.0:1788792095.127989:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785829376 00000100:00100000:3.0:1788792095.127999:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785830144 00000100:00100000:3.0:1788792095.128002:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785830144 00000100:00100000:3.0:1788792095.128014:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788792095.128019:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875683785829888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.128051:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875683785829888:12345-0@lo:400:kworker.0 Request processed in 31us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792095.128057:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788792095.128069:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788792095.128074:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875683785830016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792095.130073:0:22666:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788792095.130289:0:22666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788792095.130330:0:22664:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788792095.130360:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788792095.130744:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875683785830016:12345-0@lo:400:kworker.0 Request processed in 2665us (3713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792095.130757:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788792095.130791:0:22665:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788792095.130799:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788792095.130815:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875683785830144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.130860:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875683785830144:12345-0@lo:400:kworker.0 Request processed in 54us (3519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792095.130867:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788792095.130910:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788792095.130916:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788792095.131071:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043f50e00 x1875683785830144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788792095.131299:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785829376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792095.131343:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785829376:12345-0@lo:400:kworker.0 Request processed in 51us (4261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792095.131350:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788792095.132540:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875683785830144:0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.132576:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785829248:0@lo:400:kworker.0 00010000:00080000:3.0:1788792095.132607:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043f52a00 x1875683785830016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792095.132619:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875683785830016:0@lo:400:kworker.0 00010000:00080000:3.0:1788792095.132655:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043c48a80 x1875683785829376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792095.132664:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785829376:0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.132703:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785829120:0@lo:400:kworker.0 00010000:00080000:3.0:1788792095.132716:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043f50380 x1875683785829888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792095.132725:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875683785829888:0@lo:400:kworker.0 00000100:00100000:3.0:1788792095.132735:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785829504:0@lo:400:kworker.0 00000100:00100000:1.0:1788792095.139763:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785829632:0@lo:8:kworker.0 00000100:00100000:1.0:1788792095.139966:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792095.140022:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785829760:0@lo:8:kworker.0 00000100:00100000:1.0:1788792095.140051:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792095.140566:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785829632 00000100:00100000:3.0:1788792095.140576:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785829632 00000100:00100000:3.0:1788792095.140617:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785829760 00000100:00100000:3.0:1788792095.140621:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785829760 00000100:00100000:3.0:1788792095.140642:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788792095.140651:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875683785829632:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788792095.140696:0:24171:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 738 last 0 00000020:00000080:3.0:1788792095.140737:0:24171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4d37c11031f3648f 00002000:00100000:3.0:1788792095.140758:0:24171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8c614f315800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788792095.140763:0:24171:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788792095.140765:0:24171:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788792095.140996:0:24171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788792095.141039:0:24171:0:(import.c:65:import_set_state_nolock()) ffff8c614f311000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788792095.141136:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1875683785829632:12345-0@lo:8:kworker.0 Request processed in 485us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792095.141150:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788792095.141170:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788792095.141174:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875683785829760:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788792095.141188:0:24171:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788792095.145008:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043c48e00 x1875683785829632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788792115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788792095.145034:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788792095.145048:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788792095.145067:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788792095.145076:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788792095.145093:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c617c331000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788792095.145131:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788792095.145140:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785829632:0@lo:8:kworker.0 00000004:00080000:1.0:1788792095.145288:0:23406:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788792095.145398:0:23406:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 738162524855ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788792095.145405:0:23406:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788792095.153691:0:23407:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788792095.153727:0:23407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23407:1875683785830400:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788792095.153795:0:23407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792095.153827:0:23407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6175e14480 going to sleep for 11 seconds 00000100:00100000:2.0:1788792095.153841:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788792095.153852:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785830272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788792095.153900:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792095.153946:0:24170:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788792095.153954:0:24170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:2.0:1788792095.156282:0:23397:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788792095.166032:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785830272 00000100:00100000:2.0:1788792095.166054:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785830272 00000100:00100000:2.0:1788792095.166134:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788792095.166147:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875683785830272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788792095.166198:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788792095.166313:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875683785830272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 169us (12411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792095.166322:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788792095.166367:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043709180 x1875683785830272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788792111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788792095.166391:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785830272:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788792095.166627:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788792095.170546:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785830400 00000100:00100000:1.0:1788792095.170574:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785830400 00000100:00100000:2.0:1788792095.174590:0:24651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788792095.174608:0:24651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23407:x1875683785830400:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:2.0:1788792095.182784:0:24651:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788792095.182800:0:24651:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788792095.182942:0:24651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23407:x1875683785830400:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8333us (29140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792095.182953:0:24651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788792095.185756:0:23407:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043708000 x1875683785830400/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788792111 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792095.185776:0:23407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23407:1875683785830400:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788792095.185791:0:23407:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788792095.185842:0:23407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23407:1875683785830528:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788792095.185926:0:23407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792095.185960:0:23407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c614f74c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788792095.185985:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785830528 00000100:00100000:1.0:1788792095.185992:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785830528 00000100:00100000:1.0:1788792095.186039:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788792095.186049:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23407:x1875683785830528:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788792095.186076:0:24170:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788792095.186129:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23407:x1875683785830528:12345-0@lo:5:osp-pre-0-1.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792095.186137:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788792095.186173:0:23407:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043d15f80 x1875683785830528/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788792111 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792095.186183:0:23407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23407:1875683785830528:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788792095.186192:0:23407:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788792095.186216:0:23407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23407:1875683785830656:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788792095.186238:0:23407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792095.186254:0:23407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c614f74c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788792095.188140:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875683785829760:12345-0@lo:8:kworker.0 Request processed in 46955us (48079us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788792095.188153:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788792095.188203:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6043e91000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788792095.188208:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788792095.188211:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785829760:0@lo:8:kworker.0 00000100:00100000:3.0:1788792095.188239:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785830656 00000100:00100000:3.0:1788792095.188246:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785830656 00000100:00100000:3.0:1788792095.188293:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788792095.188302:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23407:x1875683785830656:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788792095.188344:0:24170:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:1.0:1788792095.290352:0:24166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788792095.290378:0:24166:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788792095.294385:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23407:x1875683785830656:12345-0@lo:5:osp-pre-0-1.0 Request processed in 106070us (108131us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788792095.294400:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788792095.294437:0:23407:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043d15f80 x1875683785830656/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788792111 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792095.294452:0:23407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788792095.294461:0:23407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23407:1875683785830656:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788792095.294478:0:23407:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1788792095.294548:0:23407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f50380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23407:1875683785830784:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788792095.294601:0:23407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792095.294644:0:23407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b3000 going to sleep for 11 seconds 00000100:00100000:3.0:1788792095.294677:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785830784 00000100:00100000:3.0:1788792095.294685:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785830784 00000100:00100000:3.0:1788792095.294740:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788792095.294752:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23407:x1875683785830784:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788792095.294803:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23407:x1875683785830784:12345-0@lo:900:osp-pre-0-1.0 Request processed in 53us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792095.294810:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788792095.294834:0:23407:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043f50380 x1875683785830784/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788792111 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792095.294844:0:23407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f50380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23407:1875683785830784:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1788792095.767388:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788792096.280617:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785830912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788792096.280705:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792096.280781:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785830912 00000100:00100000:1.0:1788792096.280790:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785830912 00000100:00100000:1.0:1788792096.280849:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788792096.280862:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785830912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788792096.280928:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788792096.280989:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785830912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792096.280996:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788792096.281215:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788792096.281226:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785831040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788792096.281257:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792096.281286:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785831040 00000100:00100000:0.0:1788792096.281290:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785831040 00000100:00100000:0.0:1788792096.281316:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788792096.281322:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785831040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788792096.281523:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788792096.281672:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785831040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 349us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792096.281680:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788792096.282348:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785830912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788792096.285769:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785831040:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788792096.792611:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788792097.190240:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788792097.815570:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792098.848813:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792099.874592:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788792100.320500:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788792080/real 1788792080] req@ffff8c6043d15880 x1875683785822976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792100 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792100.320532:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c6043d15880 x1875683785822976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792100 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792100.320543:0:3640:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788792080/real 1788792080] req@ffff8c6043d16d80 x1875683785823104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792100 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792100.320555:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c6043d16d80 x1875683785823104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788792100 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788792100.320574:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6174caa000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788792100.320593:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788792100.320597:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785822976:0@lo:8:kworker.0 00000100:00080000:3.0:1788792100.320616:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6043732000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788792100.320622:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788792100.320625:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785823104:0@lo:8:kworker.0 00000100:00080000:1.0:1788792100.321967:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792100.321971:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788792100.321974:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c6174caa000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788792100.321980:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 723 00000100:00080000:1.0:1788792100.321986:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788792100.321992:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c6174caa000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792100.322014:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d14e00 x1875683785831424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788792100.322027:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792100.322031:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788792100.322032:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c6043732000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788792100.322035:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 723 00000100:00080000:1.0:1788792100.322038:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788792100.322041:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c6043732000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792100.322051:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d16d80 x1875683785831552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788792100.322078:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792100.322092:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788792100.322094:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c6043e91000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788792100.322098:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 738 00000100:00080000:1.0:1788792100.322102:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788792100.322105:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c6043e91000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792100.322118:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6151f4c380 x1875683785832064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788792100.322169:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785831808:0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.322250:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792100.322314:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875683785832448:0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.322351:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792100.322375:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788792100.322380:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785831168:0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.322415:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792100.322440:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785831936:0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.322465:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792100.322496:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785831808 00000100:00100000:1.0:1788792100.322504:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785831808 00000100:00100000:1.0:1788792100.322547:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788792100.322557:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785831808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.322621:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785831808:12345-0@lo:400:kworker.0 Request processed in 65us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792100.322629:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788792100.322654:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785831168 00000100:00100000:1.0:1788792100.322657:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785831168 00000100:00100000:1.0:1788792100.322689:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788792100.322694:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:3641:x1875683785831168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.322722:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:3641:x1875683785831168:12345-0@lo:400:kworker.0 Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792100.322727:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788792100.322756:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785831936 00000100:00100000:1.0:1788792100.322760:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785831936 00000100:00100000:1.0:1788792100.322791:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788792100.322798:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785831936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.322841:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785831936:12345-0@lo:400:kworker.0 Request processed in 32us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792100.322848:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788792100.322921:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785831168:0@lo:400:kworker.0 00010000:00080000:1.0:1788792100.322936:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043d15f80 x1875683785831936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788792116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792100.322946:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785831936:0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.322955:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785831808:0@lo:400:kworker.0 00000100:00100000:3.0:1788792100.323110:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785831424:0@lo:8:kworker.0 00000100:00100000:3.0:1788792100.323144:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792100.324258:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875683785831680:0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.324364:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792100.324397:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875683785832320:0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.324420:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792100.324444:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788792100.324450:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785831296:0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.324475:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792100.324513:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875683785832192:0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.324535:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792100.325040:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785832448 00000100:00100000:1.0:1788792100.325049:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785832448 00000100:00100000:1.0:1788792100.325098:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785831680 00000100:00100000:1.0:1788792100.325101:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785831680 00000100:00100000:1.0:1788792100.325113:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785832320 00000100:00100000:1.0:1788792100.325115:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785832320 00000100:00100000:1.0:1788792100.325129:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785832192 00000100:00100000:1.0:1788792100.325132:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785832192 00000100:00100000:1.0:1788792100.325148:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788792100.325156:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875683785832448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.325221:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875683785832448:12345-0@lo:400:kworker.0 Request processed in 65us (2869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792100.325229:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788792100.325246:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788792100.325253:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875683785831680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.325368:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875683785831680:12345-0@lo:400:kworker.0 Request processed in 116us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792100.325375:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788792100.325388:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788792100.325395:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875683785832320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.325422:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875683785832320:12345-0@lo:400:kworker.0 Request processed in 29us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792100.325428:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788792100.325439:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788792100.325445:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875683785832192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792100.325483:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875683785832192:12345-0@lo:400:kworker.0 Request processed in 38us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792100.325489:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788792100.325531:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6151f4ca80 x1875683785832192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792100.325543:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875683785832192:0@lo:400:kworker.0 00010000:00080000:1.0:1788792100.325553:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043d15880 x1875683785831680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792100.325575:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875683785831680:0@lo:400:kworker.0 00010000:00080000:1.0:1788792100.325588:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6151f4e300 x1875683785832320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792100.325596:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875683785832320:0@lo:400:kworker.0 00010000:00080000:1.0:1788792100.325632:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6151f4e680 x1875683785832448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792100.325641:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875683785832448:0@lo:400:kworker.0 00000100:00100000:0.0:1788792100.325908:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785831296 00000100:00100000:0.0:1788792100.325915:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785831296 00000100:00100000:0.0:1788792100.325952:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788792100.325960:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785831296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792100.326006:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785831296:12345-0@lo:400:kworker.0 Request processed in 47us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792100.326012:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788792100.326029:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788792100.326033:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788792100.326036:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788792100.326058:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785831296:0@lo:400:kworker.0 00000100:00100000:3.0:1788792100.326167:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785831552:0@lo:8:kworker.0 00000100:00100000:3.0:1788792100.326199:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792100.326227:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785832064:0@lo:8:kworker.0 00000100:00100000:3.0:1788792100.326249:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792100.326370:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785831424 00000100:00100000:0.0:1788792100.326375:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785831424 00000100:00100000:0.0:1788792100.326390:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785831552 00000100:00100000:0.0:1788792100.326392:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785831552 00000100:00100000:0.0:1788792100.326400:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785832064 00000100:00100000:0.0:1788792100.326402:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785832064 00000100:00100000:0.0:1788792100.326412:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788792100.326416:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875683785831424:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788792100.326440:0:24170:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 743 last 0 00000020:00000080:0.0:1788792100.326477:0:24170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4d37c11031f36496 00002000:00100000:0.0:1788792100.326490:0:24170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c60444f9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788792100.326494:0:24170:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788792100.326497:0:24170:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788792100.326585:0:24170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788792100.326608:0:24170:0:(import.c:65:import_set_state_nolock()) ffff8c60444fe000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788792100.326651:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875683785831424:12345-0@lo:8:kworker.0 Request processed in 233us (3506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792100.326657:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788792100.326668:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788792100.326673:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875683785831552:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788792100.326684:0:24170:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788792100.326721:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875683785831552:12345-0@lo:8:kworker.0 Request processed in 46us (521us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788792100.326726:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788792100.326737:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788792100.326740:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875683785832064:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788792100.326748:0:24170:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788792100.326769:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875683785832064:12345-0@lo:8:kworker.0 Request processed in 27us (519us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788792100.326773:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788792100.326801:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043d14e00 x1875683785831424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788792125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792100.326810:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788792100.326818:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788792100.326842:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788792100.326847:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788792100.326850:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6174caa000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788792100.326864:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788792100.326870:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785831424:0@lo:8:kworker.0 00000100:00080000:0.0:1788792100.326907:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6043732000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788792100.326911:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788792100.326914:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785831552:0@lo:8:kworker.0 00000100:00080000:0.0:1788792100.326925:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6043e91000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788792100.326928:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788792100.326931:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785832064:0@lo:8:kworker.0 00000004:00080000:0.0:1788792100.326953:0:22688:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788792100.327014:0:22688:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743344140644ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788792100.327020:0:22688:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788792100.330124:0:22689:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788792100.330159:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22689:1875683785832704:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788792100.330231:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792100.330265:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60437c1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788792100.330346:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785832704 00000100:00100000:3.0:1788792100.330354:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785832704 00000100:00100000:3.0:1788792100.330408:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788792100.330417:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22689:x1875683785832704:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788792100.330697:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785832576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788792100.330728:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792100.330770:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785832576 00000100:00100000:3.0:1788792100.330774:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785832576 00000100:00100000:3.0:1788792100.330799:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788792100.330806:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875683785832576:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788792100.331374:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788792100.332060:0:22644:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00000024:3.0:1788792100.332219:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788792100.333151:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875683785832576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2339us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792100.333168:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788792100.333272:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043f51180 x1875683785832576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788792116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792100.333308:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785832576:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1788792100.339128:0:24171:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788792100.339142:0:24171:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:0.0:1788792100.339151:0:24171:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00002000:00010000:0.0:1788792100.362936:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788792100.362949:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d28721e6/0x4d37c11031f3649d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.362968:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=743s v=(0 0) 00010000:00010000:0.0:1788792100.362973:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788792100.362981:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d28721e6/0x4d37c11031f3649d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.363014:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d28721e6/0x4d37c11031f3649d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.363025:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d28721e6/0x4d37c11031f3649d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.363033:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d28721e6/0x4d37c11031f3649d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.363056:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788792100.363069:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788792100.363075:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d28721e6/0x4d37c11031f3649d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.363083:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b953e00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788792100.363088:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d28721e6/0x4d37c11031f3649d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.363096:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d28721e6/0x4d37c11031f3649d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.363113:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d28721e6/0x4d37c11031f3649d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.363120:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d28721e6/0x4d37c11031f3649d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.363225:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.363228:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.363230:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788792100.363995:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788792100.364003:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3384b5a/0x4d37c11031f364a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.364014:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=743s v=(0 0) 00010000:00010000:0.0:1788792100.364017:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788792100.364021:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3384b5a/0x4d37c11031f364a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.364031:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3384b5a/0x4d37c11031f364a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.364040:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3384b5a/0x4d37c11031f364a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.364048:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3384b5a/0x4d37c11031f364a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.364110:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788792100.364947:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788792100.364955:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3d780af/0x4d37c11031f364ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.364974:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=743s v=(0 0) 00010000:00010000:0.0:1788792100.364977:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788792100.364982:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d780af/0x4d37c11031f364ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.364993:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3d780af/0x4d37c11031f364ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.365002:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3d780af/0x4d37c11031f364ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.365009:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d780af/0x4d37c11031f364ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.369651:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788792100.369668:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3384b5a/0x4d37c11031f364a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.369686:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b953a00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792100.369711:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3384b5a/0x4d37c11031f364a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.369725:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3384b5a/0x4d37c11031f364a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.369759:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3384b5a/0x4d37c11031f364a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.369767:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3384b5a/0x4d37c11031f364a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.369790:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792100.369794:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3d780af/0x4d37c11031f364ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.369800:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b953800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792100.369803:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3d780af/0x4d37c11031f364ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.369811:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3d780af/0x4d37c11031f364ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.369821:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3d780af/0x4d37c11031f364ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.369838:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.369845:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.369847:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.369944:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788792100.369952:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3d780af/0x4d37c11031f364ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788792100.370601:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788792100.370609:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f60a413/0x4d37c11031f364b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.370625:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=743s v=(0 0) 00010000:00010000:0.0:1788792100.370629:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788792100.370635:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f60a413/0x4d37c11031f364b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.370661:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f60a413/0x4d37c11031f364b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.370670:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f60a413/0x4d37c11031f364b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.370678:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f60a413/0x4d37c11031f364b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.370696:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788792100.370998:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788792100.371004:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039055962/0x4d37c11031f364b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371013:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=743s v=(0 0) 00010000:00010000:0.0:1788792100.371017:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788792100.371021:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039055962/0x4d37c11031f364b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371029:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039055962/0x4d37c11031f364b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371037:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039055962/0x4d37c11031f364b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371056:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039055962/0x4d37c11031f364b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371066:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788792100.371393:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788792100.371398:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e71c8a8d/0x4d37c11031f364c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371407:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=743s v=(0 0) 00010000:00010000:0.0:1788792100.371410:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788792100.371415:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e71c8a8d/0x4d37c11031f364c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371423:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e71c8a8d/0x4d37c11031f364c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371430:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e71c8a8d/0x4d37c11031f364c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371437:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e71c8a8d/0x4d37c11031f364c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371445:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788792100.371684:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788792100.371690:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034f9e28a/0x4d37c11031f364c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371705:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=743s v=(0 0) 00010000:00010000:0.0:1788792100.371708:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788792100.371712:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034f9e28a/0x4d37c11031f364c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371721:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034f9e28a/0x4d37c11031f364c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371729:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034f9e28a/0x4d37c11031f364c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371737:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034f9e28a/0x4d37c11031f364c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.371746:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788792100.372007:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788792100.372013:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2fae8f1/0x4d37c11031f364ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.372021:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=743s v=(0 0) 00010000:00010000:0.0:1788792100.372024:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788792100.372028:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fae8f1/0x4d37c11031f364ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.372037:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2fae8f1/0x4d37c11031f364ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.372056:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2fae8f1/0x4d37c11031f364ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.372063:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fae8f1/0x4d37c11031f364ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.372071:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788792100.372437:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788792100.372444:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f60a413/0x4d37c11031f364b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372452:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b952c00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792100.372457:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f60a413/0x4d37c11031f364b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372466:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f60a413/0x4d37c11031f364b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372485:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f60a413/0x4d37c11031f364b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372492:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f60a413/0x4d37c11031f364b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372511:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788792100.372515:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039055962/0x4d37c11031f364b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372522:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b953000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792100.372525:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039055962/0x4d37c11031f364b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372544:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039055962/0x4d37c11031f364b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372554:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039055962/0x4d37c11031f364b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372561:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039055962/0x4d37c11031f364b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372574:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788792100.372578:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e71c8a8d/0x4d37c11031f364c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372585:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b952400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792100.372588:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e71c8a8d/0x4d37c11031f364c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372595:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e71c8a8d/0x4d37c11031f364c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372605:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e71c8a8d/0x4d37c11031f364c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372613:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e71c8a8d/0x4d37c11031f364c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372637:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788792100.372640:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034f9e28a/0x4d37c11031f364c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372647:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b953200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792100.372650:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034f9e28a/0x4d37c11031f364c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372657:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034f9e28a/0x4d37c11031f364c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372667:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034f9e28a/0x4d37c11031f364c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372674:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034f9e28a/0x4d37c11031f364c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372684:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792100.372688:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2fae8f1/0x4d37c11031f364ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372694:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086c800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792100.372697:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2fae8f1/0x4d37c11031f364ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372715:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2fae8f1/0x4d37c11031f364ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372725:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2fae8f1/0x4d37c11031f364ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372731:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2fae8f1/0x4d37c11031f364ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.372744:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792100.372746:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792100.372747:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788792100.373090:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788792100.373097:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006785f5d3/0x4d37c11031f364d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.373106:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=743s v=(0 0) 00010000:00010000:0.0:1788792100.373109:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788792100.373114:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006785f5d3/0x4d37c11031f364d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.373124:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006785f5d3/0x4d37c11031f364d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.373132:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006785f5d3/0x4d37c11031f364d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.373140:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006785f5d3/0x4d37c11031f364d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.373257:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.373382:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788792100.373690:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788792100.373696:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3267f11/0x4d37c11031f364dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.373704:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=743s v=(0 0) 00010000:00010000:0.0:1788792100.373707:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788792100.373712:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3267f11/0x4d37c11031f364dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.373722:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3267f11/0x4d37c11031f364dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.373729:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3267f11/0x4d37c11031f364dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.373736:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3267f11/0x4d37c11031f364dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.376054:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788792100.376070:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006785f5d3/0x4d37c11031f364d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.376086:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086d800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792100.376093:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006785f5d3/0x4d37c11031f364d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.376105:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006785f5d3/0x4d37c11031f364d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.376129:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006785f5d3/0x4d37c11031f364d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.376172:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006785f5d3/0x4d37c11031f364d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.376202:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792100.376206:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3267f11/0x4d37c11031f364dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.376213:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086d200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792100.376216:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3267f11/0x4d37c11031f364dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.376224:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3267f11/0x4d37c11031f364dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.376236:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3267f11/0x4d37c11031f364dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.376243:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792100.376245:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792100.376247:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.381034:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788792100.381052:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3267f11/0x4d37c11031f364dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.381458:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788792100.382334:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788792100.382345:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdacff80/0x4d37c11031f364e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.382363:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=743s v=(0 0) 00010000:00010000:1.0:1788792100.382368:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788792100.382375:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdacff80/0x4d37c11031f364e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.382391:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdacff80/0x4d37c11031f364e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.382402:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdacff80/0x4d37c11031f364e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.382410:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdacff80/0x4d37c11031f364e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.382428:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788792100.382437:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792100.382442:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdacff80/0x4d37c11031f364e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.382450:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792100.382463:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdacff80/0x4d37c11031f364e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.382472:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdacff80/0x4d37c11031f364e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.382489:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdacff80/0x4d37c11031f364e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.382496:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdacff80/0x4d37c11031f364e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.382513:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.382514:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.382516:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788792100.382943:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788792100.382950:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b52285b/0x4d37c11031f364ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.382958:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=743s v=(0 0) 00010000:00010000:1.0:1788792100.382962:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788792100.382966:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b52285b/0x4d37c11031f364ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.382976:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b52285b/0x4d37c11031f364ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.382983:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b52285b/0x4d37c11031f364ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.382997:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b52285b/0x4d37c11031f364ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.383015:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788792100.383264:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792100.383272:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b52285b/0x4d37c11031f364ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.383291:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141688e00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792100.383303:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b52285b/0x4d37c11031f364ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.383313:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b52285b/0x4d37c11031f364ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.383327:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b52285b/0x4d37c11031f364ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.383335:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b52285b/0x4d37c11031f364ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.383352:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792100.383354:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792100.383355:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788792100.384645:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788792100.384654:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021d9334b/0x4d37c11031f364f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.384667:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=743s v=(0 0) 00010000:00010000:3.0:1788792100.384671:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792100.384676:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021d9334b/0x4d37c11031f364f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.384687:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021d9334b/0x4d37c11031f364f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.384695:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021d9334b/0x4d37c11031f364f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.384715:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021d9334b/0x4d37c11031f364f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.384737:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788792100.385176:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788792100.385183:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086b36b9b/0x4d37c11031f364f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.385192:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=743s v=(0 0) 00010000:00010000:3.0:1788792100.385195:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792100.385200:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086b36b9b/0x4d37c11031f364f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.385209:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086b36b9b/0x4d37c11031f364f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.385217:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086b36b9b/0x4d37c11031f364f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.385224:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086b36b9b/0x4d37c11031f364f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.385242:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788792100.385512:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788792100.385519:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021d9334b/0x4d37c11031f364f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.385527:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6181362400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792100.385532:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021d9334b/0x4d37c11031f364f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.385540:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021d9334b/0x4d37c11031f364f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.385555:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021d9334b/0x4d37c11031f364f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.385562:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021d9334b/0x4d37c11031f364f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.385581:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792100.385585:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086b36b9b/0x4d37c11031f364f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.385604:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6181363e00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792100.385607:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086b36b9b/0x4d37c11031f364f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.385615:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086b36b9b/0x4d37c11031f364f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.385626:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086b36b9b/0x4d37c11031f364f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.385633:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086b36b9b/0x4d37c11031f364f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.385647:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.385649:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.385651:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788792100.385730:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788792100.385736:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000215b6cbd/0x4d37c11031f364ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.385750:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=743s v=(0 0) 00010000:00010000:3.0:1788792100.385753:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792100.385757:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000215b6cbd/0x4d37c11031f364ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.385766:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000215b6cbd/0x4d37c11031f364ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.385773:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000215b6cbd/0x4d37c11031f364ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.385779:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000215b6cbd/0x4d37c11031f364ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.385799:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788792100.386124:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792100.386129:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000215b6cbd/0x4d37c11031f364ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.386138:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6181362c00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792100.386142:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000215b6cbd/0x4d37c11031f364ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.386151:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000215b6cbd/0x4d37c11031f364ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.386170:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000215b6cbd/0x4d37c11031f364ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.386177:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000215b6cbd/0x4d37c11031f364ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.386192:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.386193:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.386195:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.386247:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788792100.386332:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788792100.386339:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e447829b/0x4d37c11031f36506 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.386346:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=743s v=(0 0) 00010000:00010000:3.0:1788792100.386350:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792100.386354:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e447829b/0x4d37c11031f36506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.386363:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e447829b/0x4d37c11031f36506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.386383:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e447829b/0x4d37c11031f36506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.386390:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e447829b/0x4d37c11031f36506 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.386409:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788792100.386656:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792100.386660:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e447829b/0x4d37c11031f36506 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.386668:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6181363400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792100.386672:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e447829b/0x4d37c11031f36506 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.386680:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e447829b/0x4d37c11031f36506 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.386692:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e447829b/0x4d37c11031f36506 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.386699:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e447829b/0x4d37c11031f36506 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.386726:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.386727:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.386729:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788792100.387053:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788792100.387059:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9fbc79f/0x4d37c11031f3650d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.387067:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=743s v=(0 0) 00010000:00010000:3.0:1788792100.387070:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792100.387075:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9fbc79f/0x4d37c11031f3650d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.387086:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9fbc79f/0x4d37c11031f3650d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.387093:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9fbc79f/0x4d37c11031f3650d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.387101:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9fbc79f/0x4d37c11031f3650d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.387134:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788792100.387386:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788792100.387402:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9fbc79f/0x4d37c11031f3650d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.387411:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413aac00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788792100.387414:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9fbc79f/0x4d37c11031f3650d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.387422:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9fbc79f/0x4d37c11031f3650d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.387434:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9fbc79f/0x4d37c11031f3650d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.387441:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9fbc79f/0x4d37c11031f3650d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.387458:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.387460:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.387461:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788792100.387596:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788792100.387601:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a5d4228/0x4d37c11031f36514 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.387610:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=743s v=(0 0) 00010000:00010000:3.0:1788792100.387613:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792100.387617:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a5d4228/0x4d37c11031f36514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.387627:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a5d4228/0x4d37c11031f36514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.387635:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a5d4228/0x4d37c11031f36514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.387643:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a5d4228/0x4d37c11031f36514 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.387696:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788792100.388494:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785832832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788792100.388571:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1788792100.388719:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792100.388727:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dc2bc99/0x4d37c11031f3651b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.388739:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=743s v=(0 0) 00010000:00010000:2.0:1788792100.388743:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792100.388748:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dc2bc99/0x4d37c11031f3651b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.388760:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dc2bc99/0x4d37c11031f3651b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.388768:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dc2bc99/0x4d37c11031f3651b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.388776:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dc2bc99/0x4d37c11031f3651b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792100.388843:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785832832 00000100:00100000:3.0:1788792100.388851:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785832832 00000100:00100000:3.0:1788792100.388924:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788792100.388934:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785832832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788792100.388955:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788792100.389009:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785832832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792100.389017:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788792100.389118:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785832832:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788792100.391700:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788792100.391715:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a5d4228/0x4d37c11031f36514 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.391729:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413aa200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792100.391735:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a5d4228/0x4d37c11031f36514 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.391747:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a5d4228/0x4d37c11031f36514 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.391770:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a5d4228/0x4d37c11031f36514 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.391778:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a5d4228/0x4d37c11031f36514 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.391966:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792100.391972:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dc2bc99/0x4d37c11031f3651b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.391980:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140031800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792100.391990:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dc2bc99/0x4d37c11031f3651b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.391998:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dc2bc99/0x4d37c11031f3651b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.392009:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dc2bc99/0x4d37c11031f3651b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.392018:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.392019:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.392021:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792100.396383:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788792100.396400:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dc2bc99/0x4d37c11031f3651b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.396849:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788792100.397005:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792100.397012:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d9c02ea/0x4d37c11031f36522 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.397027:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=743s v=(0 0) 00010000:00010000:2.0:1788792100.397031:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792100.397037:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d9c02ea/0x4d37c11031f36522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.397051:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d9c02ea/0x4d37c11031f36522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.397061:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d9c02ea/0x4d37c11031f36522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.397069:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d9c02ea/0x4d37c11031f36522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.397083:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788792100.397383:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792100.397392:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d9c02ea/0x4d37c11031f36522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.397402:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140031c00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792100.397407:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d9c02ea/0x4d37c11031f36522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.397418:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d9c02ea/0x4d37c11031f36522 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.397438:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d9c02ea/0x4d37c11031f36522 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.397446:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d9c02ea/0x4d37c11031f36522 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.397468:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.397470:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.397472:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788792100.397641:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792100.397647:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000890e600c/0x4d37c11031f36529 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.397661:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=743s v=(0 0) 00010000:00010000:2.0:1788792100.397664:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792100.397669:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000890e600c/0x4d37c11031f36529 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.397679:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000890e600c/0x4d37c11031f36529 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.397687:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000890e600c/0x4d37c11031f36529 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.397695:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000890e600c/0x4d37c11031f36529 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.397713:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788792100.398416:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788792100.398424:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000890e600c/0x4d37c11031f36529 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.398445:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140030000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788792100.398450:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000890e600c/0x4d37c11031f36529 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.398458:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000890e600c/0x4d37c11031f36529 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.398472:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000890e600c/0x4d37c11031f36529 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.398478:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000890e600c/0x4d37c11031f36529 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.398493:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.398495:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.398497:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788792100.398693:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792100.398700:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0daed30/0x4d37c11031f36530 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.398710:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=743s v=(0 0) 00010000:00010000:2.0:1788792100.398713:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792100.398717:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0daed30/0x4d37c11031f36530 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.398726:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0daed30/0x4d37c11031f36530 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.398744:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0daed30/0x4d37c11031f36530 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.398752:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0daed30/0x4d37c11031f36530 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.398772:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788792100.399117:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792100.399123:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0daed30/0x4d37c11031f36530 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.399132:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140031400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792100.399136:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0daed30/0x4d37c11031f36530 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.399145:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0daed30/0x4d37c11031f36530 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.399166:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0daed30/0x4d37c11031f36530 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.399174:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0daed30/0x4d37c11031f36530 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.399192:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.399194:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.399195:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788792100.399334:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792100.399340:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bb8133b/0x4d37c11031f36537 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.399348:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=743s v=(0 0) 00010000:00010000:2.0:1788792100.399351:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792100.399356:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bb8133b/0x4d37c11031f36537 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.399365:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bb8133b/0x4d37c11031f36537 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.399374:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bb8133b/0x4d37c11031f36537 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.399382:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bb8133b/0x4d37c11031f36537 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.399413:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788792100.399524:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788792100.399530:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bb8133b/0x4d37c11031f36537 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.399537:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140031600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788792100.399541:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bb8133b/0x4d37c11031f36537 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.399550:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bb8133b/0x4d37c11031f36537 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.399568:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bb8133b/0x4d37c11031f36537 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.399575:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bb8133b/0x4d37c11031f36537 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.399592:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.399593:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.399595:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788792100.401537:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792100.401552:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092fe7ac4/0x4d37c11031f3653e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.401569:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=743s v=(0 0) 00010000:00010000:2.0:1788792100.401573:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792100.401579:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092fe7ac4/0x4d37c11031f3653e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.401594:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092fe7ac4/0x4d37c11031f3653e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.401603:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092fe7ac4/0x4d37c11031f3653e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.401611:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092fe7ac4/0x4d37c11031f3653e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.401638:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788792100.402043:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792100.402051:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092fe7ac4/0x4d37c11031f3653e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.402072:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140030a00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792100.402078:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092fe7ac4/0x4d37c11031f3653e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.402090:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092fe7ac4/0x4d37c11031f3653e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.402109:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092fe7ac4/0x4d37c11031f3653e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.402117:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092fe7ac4/0x4d37c11031f3653e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.402137:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.402139:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.402141:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788792100.402402:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792100.402408:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000838e295c/0x4d37c11031f36545 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.402417:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=743s v=(0 0) 00010000:00010000:2.0:1788792100.402428:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792100.402433:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000838e295c/0x4d37c11031f36545 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.402442:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000838e295c/0x4d37c11031f36545 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.402450:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000838e295c/0x4d37c11031f36545 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.402456:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000838e295c/0x4d37c11031f36545 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.402509:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788792100.404690:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792100.404706:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c95024e1/0x4d37c11031f3654c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.404725:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=743s v=(0 0) 00010000:00010000:2.0:1788792100.404728:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792100.404734:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c95024e1/0x4d37c11031f3654c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.404748:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c95024e1/0x4d37c11031f3654c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.404758:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c95024e1/0x4d37c11031f3654c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792100.404779:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c95024e1/0x4d37c11031f3654c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.408907:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788792100.408924:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000838e295c/0x4d37c11031f36545 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.408942:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e67600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788792100.408948:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000838e295c/0x4d37c11031f36545 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.408960:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000838e295c/0x4d37c11031f36545 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.408985:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000838e295c/0x4d37c11031f36545 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.408993:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000838e295c/0x4d37c11031f36545 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.409040:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788792100.409045:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c95024e1/0x4d37c11031f3654c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.409051:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e66200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788792100.409054:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c95024e1/0x4d37c11031f3654c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.409062:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c95024e1/0x4d37c11031f3654c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.409072:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c95024e1/0x4d37c11031f3654c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.409080:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.409081:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.409084:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792100.415430:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788792100.415450:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c95024e1/0x4d37c11031f3654c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.415565:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788792100.416539:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788792100.416549:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091e673df/0x4d37c11031f36553 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.416565:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=743s v=(0 0) 00010000:00010000:3.0:1788792100.416570:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792100.416577:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091e673df/0x4d37c11031f36553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.416592:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091e673df/0x4d37c11031f36553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.416603:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091e673df/0x4d37c11031f36553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.416610:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091e673df/0x4d37c11031f36553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.416666:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788792100.420315:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788792100.420333:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b295f167/0x4d37c11031f3655a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.420353:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=743s v=(0 0) 00010000:00010000:3.0:1788792100.420367:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792100.420375:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b295f167/0x4d37c11031f3655a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.420392:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b295f167/0x4d37c11031f3655a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.420403:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b295f167/0x4d37c11031f3655a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.420411:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b295f167/0x4d37c11031f3655a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.428583:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788792100.428602:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091e673df/0x4d37c11031f36553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.428620:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413ab600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788792100.428625:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091e673df/0x4d37c11031f36553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.428663:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091e673df/0x4d37c11031f36553 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.428689:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091e673df/0x4d37c11031f36553 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.428696:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091e673df/0x4d37c11031f36553 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.428722:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788792100.428726:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b295f167/0x4d37c11031f3655a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.428733:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413aba00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788792100.428736:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b295f167/0x4d37c11031f3655a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.428743:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b295f167/0x4d37c11031f3655a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.428752:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b295f167/0x4d37c11031f3655a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.428759:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.428761:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.428769:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792100.429105:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788792100.429115:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b295f167/0x4d37c11031f3655a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.429631:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788792100.429854:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788792100.429862:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f746efd8/0x4d37c11031f36561 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.429900:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=743s v=(0 0) 00010000:00010000:3.0:1788792100.429905:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792100.429912:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f746efd8/0x4d37c11031f36561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.429924:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f746efd8/0x4d37c11031f36561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.429941:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f746efd8/0x4d37c11031f36561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.429948:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f746efd8/0x4d37c11031f36561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.429965:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788792100.430232:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788792100.430239:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f746efd8/0x4d37c11031f36561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.430247:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413aa600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788792100.430252:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f746efd8/0x4d37c11031f36561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.430261:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f746efd8/0x4d37c11031f36561 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.430288:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f746efd8/0x4d37c11031f36561 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.430296:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f746efd8/0x4d37c11031f36561 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.430315:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.430317:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.430319:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788792100.430429:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788792100.430435:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6ae5147/0x4d37c11031f36568 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.430443:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=743s v=(0 0) 00010000:00010000:3.0:1788792100.430446:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792100.430450:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ae5147/0x4d37c11031f36568 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.430460:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6ae5147/0x4d37c11031f36568 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.430468:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6ae5147/0x4d37c11031f36568 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.430475:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ae5147/0x4d37c11031f36568 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.430508:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788792100.430802:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788792100.430809:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e619970/0x4d37c11031f3656f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.430817:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=743s v=(0 0) 00010000:00010000:3.0:1788792100.430820:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792100.430835:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e619970/0x4d37c11031f3656f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.430845:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e619970/0x4d37c11031f3656f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.430853:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e619970/0x4d37c11031f3656f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.430860:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e619970/0x4d37c11031f3656f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.430900:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788792100.431547:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788792100.431555:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6ae5147/0x4d37c11031f36568 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.431565:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413aaa00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788792100.431570:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6ae5147/0x4d37c11031f36568 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.431590:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6ae5147/0x4d37c11031f36568 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.431605:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6ae5147/0x4d37c11031f36568 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.431613:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6ae5147/0x4d37c11031f36568 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.431630:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788792100.431633:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e619970/0x4d37c11031f3656f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.431639:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413ab000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788792100.431642:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e619970/0x4d37c11031f3656f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.431650:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e619970/0x4d37c11031f3656f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.431660:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e619970/0x4d37c11031f3656f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.431668:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e619970/0x4d37c11031f3656f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792100.431697:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.431700:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.431702:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792100.431710:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788792100.432082:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788792100.432090:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078581d44/0x4d37c11031f36576 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.432100:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=743s v=(0 0) 00010000:00010000:3.0:1788792100.432110:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792100.432116:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078581d44/0x4d37c11031f36576 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.432128:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078581d44/0x4d37c11031f36576 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.432136:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078581d44/0x4d37c11031f36576 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.432143:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078581d44/0x4d37c11031f36576 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792100.432172:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788792100.433384:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792100.433395:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078581d44/0x4d37c11031f36576 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.433406:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413aa000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792100.433411:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078581d44/0x4d37c11031f36576 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.433421:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078581d44/0x4d37c11031f36576 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.433450:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078581d44/0x4d37c11031f36576 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.433457:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078581d44/0x4d37c11031f36576 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792100.433476:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.433478:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792100.433480:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788792100.433734:0:24171:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1788792100.434135:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22689:x1875683785832704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 103712us (103897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792100.434147:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788792100.434414:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22689:1875683785832704:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788792100.434434:0:22689:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1788792100.434489:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22689:1875683785832960:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788792100.434534:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792100.434574:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61474ef780 going to sleep for 11 seconds 00000100:00100000:3.0:1788792100.435391:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785832960 00000100:00100000:3.0:1788792100.435401:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785832960 00000100:00100000:3.0:1788792100.435447:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788792100.435457:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22689:x1875683785832960:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788792100.435499:0:24171:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:3.0:1788792100.451429:0:24166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1788792100.451484:0:24166:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788792100.451693:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22689:x1875683785832960:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16232us (17153us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788792100.451704:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788792100.451972:0:22689:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788792100.451981:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22689:1875683785832960:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788792100.452014:0:22689:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:0.0:1788792100.886997:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788792101.398531:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788792101.398559:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785833088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788792101.398630:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792101.398806:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785833088 00000100:00100000:0.0:1788792101.398823:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785833088 00000100:00100000:3.0:1788792101.399047:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785833216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788792101.399081:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792101.407216:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785833216 00000100:00100000:0.0:1788792101.407232:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785833216 00000100:00100000:0.0:1788792101.407351:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788792101.407365:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785833088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788792101.407406:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788792101.407498:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785833088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (8867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792101.407506:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788792101.407553:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785833088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788792101.407583:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788792101.407590:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785833216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788792101.407607:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788792101.407667:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785833216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (8584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792101.407673:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788792101.407702:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785833216:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788792101.910319:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788792102.511230:0:23423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788792102.935700:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792103.958388:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792104.982099:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788792105.447286:0:24986:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788792105.447293:0:24986:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788792105.447296:0:24986:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788792105.451072:0:24986:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c614f2c6000 00000020:01000004:1.0:1788792105.451111:0:24986:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788792105.451140:0:24986:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788792105.451167:0:24986:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8c60424acd28) 00000020:00000080:1.0:1788792105.451190:0:24986:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00000100:00080000:1.0:1788792105.494240:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792105.494249:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788792105.494254:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c6043732000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788792105.494282:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 743 00000100:00080000:1.0:1788792105.494288:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788792105.494296:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c6043732000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792105.494343:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043d14e00 x1875683785833728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788792105.494382:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788792105.494386:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788792105.494388:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c6043e91000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788792105.494392:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 743 00000100:00080000:1.0:1788792105.494395:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788792105.494399:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c6043e91000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788792105.494410:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6151f4e300 x1875683785834240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788792105.494463:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785833856:0@lo:400:kworker.0 00000100:00100000:1.0:1788792105.494566:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.494648:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875683785834496:0@lo:400:kworker.0 00000100:00100000:1.0:1788792105.494763:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.494798:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788792105.494804:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785833344:0@lo:400:kworker.0 00000100:00100000:1.0:1788792105.494844:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.494867:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785833984:0@lo:400:kworker.0 00000100:00100000:1.0:1788792105.494964:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.494986:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875683785834624:0@lo:400:kworker.0 00000100:00100000:1.0:1788792105.495007:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.495043:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785833472:0@lo:400:kworker.0 00000100:00100000:1.0:1788792105.495071:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.495090:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785834112:0@lo:400:kworker.0 00000100:00100000:1.0:1788792105.495112:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.495133:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788792105.495138:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785833600:0@lo:400:kworker.0 00000100:00100000:1.0:1788792105.495161:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.495177:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875683785834368:0@lo:400:kworker.0 00000100:00100000:1.0:1788792105.495199:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.495223:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785833728:0@lo:8:kworker.0 00000100:00100000:1.0:1788792105.495265:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.495284:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6151f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785834240:0@lo:8:kworker.0 00000100:00100000:1.0:1788792105.495305:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.495341:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785833856 00000100:00100000:1.0:1788792105.495351:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785833856 00000100:00100000:1.0:1788792105.495394:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785834496 00000100:00100000:1.0:1788792105.495397:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785834496 00000100:00100000:1.0:1788792105.495425:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785834624 00000100:00100000:1.0:1788792105.495428:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785834624 00000100:00100000:1.0:1788792105.495442:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785834368 00000100:00100000:1.0:1788792105.495445:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785834368 00000100:00100000:1.0:1788792105.495460:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788792105.495471:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785833856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792105.495536:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785833856:12345-0@lo:400:kworker.0 Request processed in 65us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792105.495543:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788792105.495561:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788792105.495574:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875683785834496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792105.495606:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875683785834496:12345-0@lo:400:kworker.0 Request processed in 33us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792105.495612:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788792105.495624:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788792105.495630:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875683785834624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792105.495864:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788792105.495889:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785834752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788792105.498011:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875683785834624:12345-0@lo:400:kworker.0 Request processed in 2367us (2988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792105.498027:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788792105.498082:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788792105.498104:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875683785834368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792105.498278:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785834112 00000100:00100000:0.0:1788792105.498288:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785834112 00000100:00100000:0.0:1788792105.498332:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785833600 00000100:00100000:0.0:1788792105.498335:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785833600 00000100:00100000:0.0:1788792105.498364:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785833728 00000100:00100000:0.0:1788792105.498367:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785833728 00000100:00100000:0.0:1788792105.498386:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785834240 00000100:00100000:0.0:1788792105.498389:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785834240 00000100:00100000:0.0:1788792105.498399:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788792105.498406:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785834112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792105.505370:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785833344 00000100:00100000:2.0:1788792105.505393:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785833344 00000100:00100000:2.0:1788792105.505491:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788792105.505507:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+21:3641:x1875683785833344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792105.506399:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788792105.506419:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785834880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788792105.506491:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792105.506556:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785834880 00000100:00100000:3.0:1788792105.506562:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785834880 00000100:00100000:3.0:1788792105.506605:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788792105.506625:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875683785834880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788792105.506658:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788792105.506703:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875683785834880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792105.506711:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788792105.506787:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785834880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788792105.506825:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792105.506849:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785834752 00000100:00100000:3.0:1788792105.506853:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785834752 00000100:00100000:3.0:1788792105.506900:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788792105.506907:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875683785834752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788792105.506918:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788792105.506947:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875683785834752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792105.506975:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788792105.507010:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785834752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788792105.510587:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788792105.510623:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785833600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792105.510781:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785833600:12345-0@lo:400:kworker.0 Request processed in 177us (15618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792105.510790:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788792105.510822:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788792105.510827:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875683785833728:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788792105.510852:0:24170:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788792105.510916:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875683785833728:12345-0@lo:8:kworker.0 Request processed in 87us (15650us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788792105.510922:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788792105.510935:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788792105.510940:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875683785834240:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788792105.510951:0:24170:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788792105.510979:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875683785834240:12345-0@lo:8:kworker.0 Request processed in 37us (15673us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788792105.510985:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788792105.511015:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785833984 00000100:00100000:3.0:1788792105.511027:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785833984 00000100:00100000:3.0:1788792105.511075:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785833472 00000100:00100000:3.0:1788792105.511079:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785833472 00000100:00100000:3.0:1788792105.511096:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788792105.511102:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785833984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792105.511166:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785833984:12345-0@lo:400:kworker.0 Request processed in 64us (16201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792105.511174:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788792105.511191:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788792105.511197:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785833472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792105.511242:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785833472:12345-0@lo:400:kworker.0 Request processed in 45us (16169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792105.511248:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788792105.511312:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785833600:0@lo:400:kworker.0 00000100:00100000:3.0:1788792105.511996:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785833472:0@lo:400:kworker.0 00000100:00080000:1.0:1788792105.519756:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6043732000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788792105.519777:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788792105.519785:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785833728:0@lo:8:kworker.0 00000100:00080000:1.0:1788792105.519803:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6043e91000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788792105.519806:0:3640:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788792105.519809:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785834240:0@lo:8:kworker.0 00000100:00080000:1.0:1788792105.519861:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788792105.519869:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788792105.519889:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788792105.519929:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785833984:0@lo:400:kworker.0 00010000:00080000:1.0:1788792105.519951:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c617b5de680 x1875683785834624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792105.519977:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875683785834624:0@lo:400:kworker.0 00010000:00080000:1.0:1788792105.520021:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043d14700 x1875683785833856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792105.520030:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785833856:0@lo:400:kworker.0 00010000:00080000:1.0:1788792105.520043:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c617b5dfb80 x1875683785834496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792105.520052:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875683785834496:0@lo:400:kworker.0 00000100:00100000:1.0:1788792105.520153:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875683785834368:12345-0@lo:400:kworker.0 Request processed in 22060us (24952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792105.520168:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788792105.520963:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6151f4ca80 x1875683785834368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792105.520975:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875683785834368:0@lo:400:kworker.0 00000100:00100000:2.0:1788792105.521083:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+21:3641:x1875683785833344:12345-0@lo:400:kworker.0 Request processed in 15578us (26236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792105.521087:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785834112:12345-0@lo:400:kworker.0 Request processed in 22681us (25972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792105.521095:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788792105.521097:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788792105.521238:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785833344:0@lo:400:kworker.0 00000100:00100000:3.0:1788792105.521589:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6151f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785834112:0@lo:400:kworker.0 00100000:10000000:2.0:1788792105.633075:0:24986:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788792105.637381:0:24986:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788792105.639499:0:24986:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788792105.640628:0:24986:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788792105.641094:0:24986:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788792105.641334:0:24986:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788792105.641557:0:24986:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1788792105.647428:0:24986:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788792105.647771:0:24986:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788792105.647811:0:24986:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788792105.647831:0:24986:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4d37c11031f36584 00000020:01000004:2.0:1788792105.647844:0:24986:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788792105.649571:0:24986:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788792105.649581:0:24986:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788792105.649592:0:24986:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788792105.649645:0:24986:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788792105.649651:0:24986:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788792105.685586:0:24986:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788792105.685667:0:24986:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.120@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788792105.685674:0:24986:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788792105.685676:0:24986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788792105.685677:0:24986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788792105.685679:0:24986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788792105.685680:0:24986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788792105.685682:0:24986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788792105.685684:0:24986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788792105.685686:0:24986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788792105.685688:0:24986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788792105.685693:0:24986:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788792105.685695:0:24986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788792105.685696:0:24986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788792105.685698:0:24986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788792105.685699:0:24986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788792105.685700:0:24986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788792105.685701:0:24986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788792105.685702:0:24986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788792105.685703:0:24986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788792105.685704:0:24986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788792105.685759:0:24986:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788792105.685794:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835008:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788792105.685956:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792105.686121:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c614f74c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788792105.689459:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785835008 00000100:00100000:1.0:1788792105.689479:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785835008 00000100:00100000:1.0:1788792105.689647:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788792105.689662:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+21:24986:x1875683785835008:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788792105.689708:0:22657:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788792105.689712:0:22657:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788792105.689716:0:22657:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788792105.690461:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+21:24986:x1875683785835008:12345-0@lo:253:mount.lustre.0 Request processed in 800us (4502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792105.690471:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788792105.690938:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835008:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788792105.690958:0:24986:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788792105.690962:0:24986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788792105.690964:0:24986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788792105.690966:0:24986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788792105.690967:0:24986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788792105.690968:0:24986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788792105.690981:0:24986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788792105.690983:0:24986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788792105.690985:0:24986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788792105.690986:0:24986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788792105.691021:0:24986:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c614f2c6000 from lustre-OST0001 10000000:01000000:0.0:1788792105.691080:0:24986:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788792105.691083:0:24986:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788792105.691094:0:24986:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c604218b370 local copy 00010000:00010000:0.0:1788792105.691107:0:24986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361be expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792105.691266:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788792105.691315:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792105.697071:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c614714b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788792105.697435:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785835136 00000100:00100000:2.0:1788792105.697448:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785835136 00000100:00100000:2.0:1788792105.697532:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788792105.697544:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:24986:x1875683785835136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788792105.697726:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:24986:x1875683785835136:12345-0@lo:501:mount.lustre.0 Request processed in 184us (6409us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788792105.697751:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788792105.700237:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835136:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788792105.700286:0:24986:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788792105.700352:0:24986:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788792105.700366:0:24986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361be expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792105.700379:0:24986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6141689400/0x4d37c11031f361b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f361be expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792105.700436:0:24986:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c614f2c6000 10000000:01000000:0.0:1788792105.700446:0:24986:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788792105.700456:0:24986:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788792105.700459:0:24986:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788792105.700466:0:24986:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788792105.700472:0:24986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788792105.700533:0:24986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c615086c000/0x4d37c11031f3658b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792105.700543:0:24986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c615086c000/0x4d37c11031f3658b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792105.700583:0:24986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c615086c000/0x4d37c11031f3658b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792105.700616:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788792105.700686:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792105.700755:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c614714b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788792105.700937:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785835264 00000100:00100000:2.0:1788792105.700948:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785835264 00000100:00100000:2.0:1788792105.701027:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788792105.701041:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:24986:x1875683785835264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788792105.701062:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792105.701083:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6174e66a00/0x4d37c11031f36592 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f3658b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792105.701114:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6174e66a00/0x4d37c11031f36592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f3658b expref: 22 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792105.701126:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6174e66a00/0x4d37c11031f36592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f3658b expref: 22 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792105.701138:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6174e66a00, rc 0) 00000100:00100000:2.0:1788792105.701205:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+22:24986:x1875683785835264:12345-0@lo:101:mount.lustre.0 Request processed in 165us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792105.701212:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788792105.705409:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788792105.705453:0:24986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c615086c000/0x4d37c11031f3658b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36592 expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792105.705470:0:24986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c615086c000/0x4d37c11031f3658b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f36592 expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788792105.716315:0:24986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788792105.717349:0:24986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788792105.724551:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788792105.724631:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788792105.724654:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788792105.724669:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788792105.724694:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788792105.724707:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788792105.724719:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788792105.724730:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788792105.724757:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788792105.724788:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788792105.724794:0:24986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788792105.724989:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788792105.725107:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.725361:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785835392 00000100:00100000:1.0:1788792105.725375:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785835392 00000100:00100000:1.0:1788792105.725474:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788792105.725490:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+22:24986:x1875683785835392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788792105.725764:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+22:24986:x1875683785835392:12345-0@lo:501:mount.lustre.0 Request processed in 277us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792105.725784:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788792105.728397:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60437c1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788792105.728452:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788792105.728524:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788792105.728634:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792105.728725:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60437c1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788792105.731504:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785835520 00000100:00100000:1.0:1788792105.731523:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785835520 00000100:00100000:0.0:1788792105.731760:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788792105.731774:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+22:24986:x1875683785835520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788792105.741512:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+22:24986:x1875683785835520:12345-0@lo:503:mount.lustre.0 Request processed in 9729us (12865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792105.741529:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788792105.741724:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835520:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788792105.742694:0:24986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788792105.742820:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b5dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788792105.742906:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.742942:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c616d3f7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788792105.743318:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785835648 00000100:00100000:0.0:1788792105.743327:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785835648 00000100:00100000:0.0:1788792105.743381:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788792105.743393:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+22:24986:x1875683785835648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792105.743898:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+22:24986:x1875683785835648:12345-0@lo:502:mount.lustre.0 Request processed in 505us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792105.743906:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788792105.744046:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b5dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788792105.744295:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788792105.744327:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788792105.744344:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788792105.744359:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788792105.744373:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788792105.744388:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788792105.744403:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788792105.744416:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788792105.744428:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788792105.744464:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788792105.744513:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792105.744543:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61608cce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788792105.744978:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785835776 00000100:00100000:0.0:1788792105.744985:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785835776 00000100:00100000:0.0:1788792105.745031:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788792105.745039:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+22:24986:x1875683785835776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788792105.745146:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+22:24986:x1875683785835776:12345-0@lo:502:mount.lustre.0 Request processed in 107us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792105.745154:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788792105.745525:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788792105.745607:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788792105.745620:0:24986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788792105.756823:0:24990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788792105.756843:0:24990:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788792105.756854:0:24990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792105.756857:0:24990:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788792105.756867:0:24990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788792105.756920:0:24990:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8c60424ab370) 00000020:00000080:1.0:1788792105.756956:0:24990:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788792105.756963:0:24990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788792105.757095:0:24990:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c614f2c6000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788792105.757109:0:24990:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788792105.757126:0:24990:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4d37c11031f365a0 00010000:00010000:2.0:1788792105.761711:0:24990:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788792105.762548:0:24990:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:2.0:1788792105.766654:0:24990:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788792105.772857:0:24990:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788792105.772904:0:24990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792105.773076:0:24990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792105.773079:0:24990:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788792105.773085:0:24990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788792105.773090:0:24990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792105.773092:0:24990:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788792105.773096:0:24990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788792105.773098:0:24990:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788792105.773100:0:24990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792105.773103:0:24990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792105.773104:0:24990:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788792105.773107:0:24990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788792105.773124:0:24990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792105.773126:0:24990:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788792105.773131:0:24990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788792105.773190:0:24990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792105.773194:0:24990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792105.773196:0:24990:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788792105.773200:0:24990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1788792105.773481:0:24986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788792105.773535:0:24986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788792105.773572:0:24986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c615086c000/0x4d37c11031f3658b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36592 expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792105.773591:0:24986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c615086c000/0x4d37c11031f3658b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36592 expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788792105.773602:0:24986:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c614f2c6000 from 1 10000000:01000000:2.0:1788792105.773607:0:24986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788792105.773669:0:24986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792105.773678:0:24986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792105.773691:0:24986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792105.773727:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788792105.773822:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792105.773863:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788792105.774704:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785835904 00000100:00100000:0.0:1788792105.774720:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785835904 00000100:00100000:0.0:1788792105.774803:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788792105.774815:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+22:24986:x1875683785835904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788792105.774840:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788792105.774859:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c615086cc00/0x4d37c11031f365ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f365a7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792105.774913:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c615086cc00/0x4d37c11031f365ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f365a7 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792105.774925:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c615086cc00/0x4d37c11031f365ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f365a7 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792105.774937:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c615086cc00, rc 0) 00000100:00100000:0.0:1788792105.775018:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+23:24986:x1875683785835904:12345-0@lo:101:mount.lustre.0 Request processed in 206us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792105.775025:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788792105.775219:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785835904:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788792105.775242:0:24986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f365ae expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.775253:0:24986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f365ae expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788792105.776745:0:24986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788792105.777125:0:24986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788792105.777767:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788792105.777799:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788792105.777814:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788792105.777827:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788792105.777840:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788792105.777854:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788792105.777865:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788792105.778390:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788792105.778411:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788792105.778427:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788792105.778439:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788792105.778459:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788792105.778463:0:24986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788792105.778582:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b5de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788792105.778673:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.778797:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c616d3f7180 going to sleep for 11 seconds 00000100:00100000:2.0:1788792105.790619:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785836032 00000100:00100000:2.0:1788792105.790641:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785836032 00000100:00100000:2.0:1788792105.790715:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788792105.790727:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+23:24986:x1875683785836032:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788792105.790999:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+23:24986:x1875683785836032:12345-0@lo:501:mount.lustre.0 Request processed in 273us (12323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792105.791008:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788792105.795246:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b5de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788792105.795363:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b5de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836160:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788792105.795499:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.795559:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6043053c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788792105.795676:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785836160 00000100:00100000:0.0:1788792105.795687:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785836160 00000100:00100000:0.0:1788792105.795787:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788792105.795798:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+23:24986:x1875683785836160:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788792105.795984:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+23:24986:x1875683785836160:12345-0@lo:503:mount.lustre.0 Request processed in 187us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792105.795993:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788792105.801058:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b5de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836160:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788792105.801814:0:24986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788792105.801999:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788792105.802129:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792105.802192:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6174f939c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788792105.802239:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785836288 00000100:00100000:3.0:1788792105.802253:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785836288 00000100:00100000:3.0:1788792105.802330:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788792105.802345:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+23:24986:x1875683785836288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788792105.802507:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+23:24986:x1875683785836288:12345-0@lo:502:mount.lustre.0 Request processed in 164us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792105.802516:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788792105.802579:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788792105.802848:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788792105.802900:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788792105.802915:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788792105.802927:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788792105.802938:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788792105.802948:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788792105.802959:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788792105.802970:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788792105.802984:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788792105.802997:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788792105.803010:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788792105.803045:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788792105.803090:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792105.803117:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785836416 00000100:00100000:3.0:1788792105.803122:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785836416 00000100:00100000:3.0:1788792105.803146:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788792105.803153:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+23:24986:x1875683785836416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788792105.803226:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+23:24986:x1875683785836416:12345-0@lo:502:mount.lustre.0 Request processed in 73us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792105.803234:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788792105.803267:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6174f939c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788792105.803280:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788792105.803318:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788792105.803333:0:24986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788792105.816526:0:24994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788792105.816542:0:24994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792105.816544:0:24994:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788792105.816553:0:24994:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c614f2c6000 00000020:00000080:1.0:1788792105.816556:0:24994:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788792105.816565:0:24994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792105.816567:0:24994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792105.816569:0:24994:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788792105.816571:0:24994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788792105.816574:0:24994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792105.816575:0:24994:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788792105.816578:0:24994:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c614f2c6000 00000020:00000080:1.0:1788792105.816580:0:24994:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788792105.816641:0:24994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792105.816645:0:24994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792105.816647:0:24994:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788792105.816650:0:24994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788792105.816653:0:24994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792105.816654:0:24994:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788792105.816657:0:24994:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c614f2c6000 00000020:00000080:1.0:1788792105.816659:0:24994:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788792105.816677:0:24994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792105.816680:0:24994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792105.816681:0:24994:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788792105.816683:0:24994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788792105.816685:0:24994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792105.816686:0:24994:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788792105.816705:0:24994:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c614f2c6000 00000020:00000080:1.0:1788792105.816707:0:24994:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788792105.816741:0:24994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788792105.816745:0:24994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788792105.816746:0:24994:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788792105.816750:0:24994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788792105.832043:0:24986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788792105.832117:0:24986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788792105.832144:0:24986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f365ae expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792105.832169:0:24986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f365ae expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788792105.832258:0:24986:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788792105.832263:0:24986:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c614f2c6000 10000000:01000000:2.0:1788792105.832266:0:24986:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c614f2c6000 10000000:01000000:2.0:1788792105.832271:0:24986:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788792105.832279:0:24986:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c614f2c6000 from 1 10000000:01000000:2.0:1788792105.832282:0:24986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788792105.832337:0:24986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6174e66000/0x4d37c11031f365b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792105.832347:0:24986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c6174e66000/0x4d37c11031f365b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792105.832363:0:24986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c6174e66000/0x4d37c11031f365b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792105.832394:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788792105.832480:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792105.832528:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788792105.836664:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785836544 00000100:00100000:2.0:1788792105.836683:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785836544 00000100:00100000:2.0:1788792105.836766:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788792105.836782:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+23:24986:x1875683785836544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788792105.836807:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792105.836830:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6174e67800/0x4d37c11031f365bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f365b5 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792105.836866:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6174e67800/0x4d37c11031f365bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f365b5 expref: 24 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792105.836909:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6174e67800/0x4d37c11031f365bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f365b5 expref: 24 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792105.836921:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6174e67800, rc 0) 00000100:00100000:2.0:1788792105.837047:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+24:24986:x1875683785836544:12345-0@lo:101:mount.lustre.0 Request processed in 269us (4566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792105.837055:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788792105.837153:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788792105.837195:0:24986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c6174e66000/0x4d37c11031f365b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f365bc expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792105.837207:0:24986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c6174e66000/0x4d37c11031f365b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f365bc expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788792105.863993:0:24986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788792105.864484:0:24986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788792105.865514:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788792105.865554:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788792105.865570:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788792105.865583:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788792105.865597:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788792105.865611:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788792105.865629:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788792105.866841:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788792105.866924:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788792105.866941:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788792105.866957:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788792105.881303:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788792105.881384:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788792105.881402:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788792105.881417:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788792105.881433:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788792105.881448:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788792105.881462:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788792105.881476:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788792105.881489:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788792105.881501:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788792105.881514:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788792105.881527:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788792105.881546:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788792105.881582:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788792105.881603:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788792105.881616:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788792105.881626:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788792105.881639:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788792105.881744:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788792105.881757:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788792105.881770:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788792105.881781:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788792105.881793:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788792105.881805:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788792105.881816:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788792105.881826:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788792105.881837:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788792105.881848:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788792105.881859:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788792105.882139:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788792105.882155:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788792105.882167:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788792105.882181:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788792105.882197:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788792105.882218:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788792105.882230:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788792105.882244:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788792105.882471:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788792105.882492:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788792105.882509:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788792105.882514:0:24986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788792105.883287:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788792105.883382:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792105.883497:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788792105.894555:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785836672 00000100:00100000:0.0:1788792105.894590:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785836672 00000100:00100000:2.0:1788792105.895016:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788792105.895030:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+24:24986:x1875683785836672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788792105.895281:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+24:24986:x1875683785836672:12345-0@lo:501:mount.lustre.0 Request processed in 253us (11897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792105.895290:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788792105.895365:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788792105.895440:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788792105.895497:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792105.895530:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785836800 00000100:00100000:2.0:1788792105.895535:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785836800 00000100:00100000:2.0:1788792105.895562:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788792105.895569:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:24986:x1875683785836800:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788792105.895671:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:24986:x1875683785836800:12345-0@lo:503:mount.lustre.0 Request processed in 102us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792105.895678:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788792105.895725:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788792105.895754:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836800:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788792105.896269:0:24986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788792105.896342:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788792105.896380:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792105.896411:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785836928 00000100:00100000:2.0:1788792105.896416:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785836928 00000100:00100000:2.0:1788792105.896442:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788792105.896449:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:24986:x1875683785836928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788792105.896542:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:24986:x1875683785836928:12345-0@lo:502:mount.lustre.0 Request processed in 92us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792105.896549:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788792105.896583:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788792105.896596:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785836928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788792105.896807:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788792105.896836:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788792105.896851:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788792105.896865:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788792105.896902:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788792105.896915:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788792105.896927:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788792105.896940:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788792105.896952:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788792105.896964:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788792105.896975:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788792105.896986:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788792105.896999:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788792105.897012:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788792105.897024:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788792105.897048:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788792105.897062:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788792105.897075:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788792105.897106:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788792105.897123:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788792105.897136:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788792105.897146:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788792105.897175:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788792105.897193:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788792105.897208:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788792105.897224:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788792105.897238:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788792105.897252:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788792105.897266:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788792105.897279:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788792105.897292:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788792105.897305:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788792105.897319:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788792105.897330:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788792105.897354:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788792105.897370:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788792105.897385:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788792105.897399:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788792105.897413:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788792105.897426:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788792105.897437:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788792105.897450:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788792105.897459:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788792105.897469:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788792105.897479:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788792105.897490:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788792105.897500:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788792105.897510:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788792105.897556:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785837056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788792105.897600:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792105.897637:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785837056 00000100:00100000:2.0:1788792105.897643:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785837056 00000100:00100000:2.0:1788792105.897683:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788792105.897691:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:24986:x1875683785837056:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788792105.897789:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:24986:x1875683785837056:12345-0@lo:502:mount.lustre.0 Request processed in 97us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792105.897796:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788792105.897841:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788792105.897858:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785837056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788792105.898042:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788792105.898062:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788792105.898082:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785837184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788792105.898117:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792105.898141:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788792105.898609:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785837184 00000100:00100000:1.0:1788792105.898617:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785837184 00000100:00100000:1.0:1788792105.898660:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788792105.898668:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:24986:x1875683785837184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788792105.898805:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:24986:x1875683785837184:12345-0@lo:502:mount.lustre.0 Request processed in 138us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792105.898813:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788792105.899199:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785837184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788792105.899257:0:24986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788792105.899272:0:24986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788792105.901367:0:25000:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788792105.901389:0:25000:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8c6043f64d28) 00000020:00000080:3.0:1788792105.901420:0:25000:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788792105.901524:0:25000:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c614f2c6000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788792105.901528:0:25000:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c614f2c6000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788792105.901531:0:25000:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c614f2c6000 3 00010000:00080000:3.0:1788792105.901575:0:25000:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c6044e6c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788792105.919051:0:25000:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788792105.919321:0:25000:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788792105.919393:0:25000:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788792105.919411:0:25000:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4d37c11031f365ca 00000100:00080000:2.0:1788792105.919427:0:25000:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788792105.919437:0:25000:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c6044e6c000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788792105.919492:0:25000:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c604370ad80 x1875683785837312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788792105.919525:0:25000:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788792105.922805:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875683785837312:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788792105.922939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792105.923096:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785837312 00000100:00100000:0.0:1788792105.923108:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785837312 00000100:00100000:0.0:1788792105.923158:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788792105.923166:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875683785837312:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788792105.923201:0:22666:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:0.0:1788792105.923249:0:22666:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4d37c11031f365d1 00000004:00100000:0.0:1788792105.923268:0:22666:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788792105.923314:0:22666:0:(import.c:65:import_set_state_nolock()) ffff8c60444ff000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788792105.923379:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875683785837312:12345-0@lo:38:llog_process_th.0 Request processed in 212us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792105.923388:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788792105.923429:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c604370ad80 x1875683785837312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788792115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792105.923442:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788792105.923452:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788792105.923461:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788792105.923465:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788792105.923473:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6044e6c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788792105.923480:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875683785837312:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1788792105.928329:0:25000:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788792105.928364:0:25000:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8c6174de19b8) 00000020:00000080:0.0:1788792105.928415:0:25000:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788792105.928568:0:25000:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c614f2c6000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788792105.928573:0:25000:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c614f2c6000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788792105.928576:0:25000:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c614f2c6000 3 00010000:00080000:0.0:1788792105.928611:0:25000:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c617dc6c000@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788792105.940283:0:25000:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788792105.940520:0:25000:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788792105.940576:0:25000:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788792105.940596:0:25000:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4d37c11031f365df 00000100:00080000:3.0:1788792105.940609:0:25000:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788792105.940615:0:25000:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8c617dc6c000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788792105.940742:0:25000:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043f51880 x1875683785837440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788792105.940781:0:25000:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788792105.941278:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875683785837440:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788792105.941378:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792105.941756:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785837440 00000100:00100000:3.0:1788792105.941768:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785837440 00000100:00100000:3.0:1788792105.941821:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788792105.941832:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875683785837440:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788792105.941894:0:24649:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:3.0:1788792105.946035:0:24649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4d37c11031f365e6 00000004:00100000:3.0:1788792105.946072:0:24649:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788792105.946145:0:24649:0:(import.c:65:import_set_state_nolock()) ffff8c60424bd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788792105.946296:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875683785837440:12345-0@lo:38:llog_process_th.0 Request processed in 4459us (4913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792105.946313:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1788792105.946511:0:25000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00010000:00080000:0.0:1788792105.948199:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c6043f51880 x1875683785837440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788792115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792105.948216:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788792105.948229:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788792105.948240:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788792105.948246:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788792105.948250:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c617dc6c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788792105.948258:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875683785837440:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1788792105.950904:0:24986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788792105.952810:0:24986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788792105.952853:0:24986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6174e66000/0x4d37c11031f365b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f365bc expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792105.952886:0:24986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6174e66000/0x4d37c11031f365b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f365bc expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788792105.953745:0:24986:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788792105.953748:0:24986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788792105.953749:0:24986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788792105.953751:0:24986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788792105.953752:0:24986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788792105.953754:0:24986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788792105.953756:0:24986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788792105.953758:0:24986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788792105.953768:0:24986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788792105.953774:0:24986:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788792105.953777:0:24986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788792105.953779:0:24986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788792105.953780:0:24986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788792105.953781:0:24986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788792105.953782:0:24986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788792105.953783:0:24986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788792105.953784:0:24986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788792105.953785:0:24986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788792105.953786:0:24986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788792105.953831:0:24986:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788792105.953863:0:24986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785837568:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788792105.955768:0:24986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792105.955843:0:24986:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c617b820540 going to sleep for 11 seconds 00000100:00100000:2.0:1788792105.957528:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785837568 00000100:00100000:2.0:1788792105.957562:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785837568 00000100:00100000:2.0:1788792105.957747:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788792105.957762:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:24986:x1875683785837568:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788792105.957814:0:22658:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788792105.957834:0:22658:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788792105.983817:0:22658:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788792105.983845:0:22658:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788792105.984501:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:24986:x1875683785837568:12345-0@lo:253:mount.lustre.0 Request processed in 26735us (28731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792105.984517:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788792105.984682:0:24986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a140336d-9a80-41e1-97b0-93600c05b204:24986:1875683785837568:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788792105.984699:0:24986:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788792105.984702:0:24986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788792105.984705:0:24986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788792105.984706:0:24986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788792105.984707:0:24986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788792105.984709:0:24986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788792105.984710:0:24986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788792105.984737:0:24986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788792105.984739:0:24986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788792105.984741:0:24986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788792105.984759:0:24986:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788792105.986065:0:22680:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788792105.986072:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788792105.986100:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792105.986119:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c6141688800/0x4d37c11031f3647a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36473 expref: 23 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792105.986128:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c6140031200/0x4d37c11031f36488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36481 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792105.986136:0:22680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792105.986195:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c6140031200/0x4d37c11031f36488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4d37c11031f36481 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792105.986214:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c6140031200/0x4d37c11031f36488 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4d37c11031f36481 expref: 23 pid: 22659 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792105.986245:0:22680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875683785837696:0@lo:104: 00000100:00100000:3.0:1788792105.986312:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788792105.986365:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c6141688800/0x4d37c11031f3647a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4d37c11031f36473 expref: 23 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792105.986374:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c6141688800/0x4d37c11031f3647a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4d37c11031f36473 expref: 23 pid: 22658 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792105.986382:0:22680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875683785837824:0@lo:104: 00000100:00100000:3.0:1788792105.986404:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792105.986427:0:22680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c617b820300 going to sleep for 11 seconds 00000100:00100000:1.0:1788792105.986448:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785837696 00000100:00100000:1.0:1788792105.986458:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785837696 00000100:00100000:1.0:1788792105.986501:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785837824 00000100:00100000:1.0:1788792105.986504:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785837824 00000100:00100000:1.0:1788792105.986520:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788792105.986531:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+4:22680:x1875683785837696:12345-0@lo:104: 00010000:00010000:1.0:1788792105.986549:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f36488 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.986622:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788792105.986628:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+4:22680:x1875683785837696:12345-0@lo:104: Request processed in 100us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792105.986635:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788792105.986653:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788792105.986660:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+3:22680:x1875683785837824:12345-0@lo:104: 00010000:00010000:1.0:1788792105.986667:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f3647a expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.986726:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788792105.986742:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+3:22680:x1875683785837824:12345-0@lo:104: Request processed in 84us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792105.986748:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788792105.986771:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788792105.986780:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f36488 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.986789:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6181363000 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:1.0:1788792105.986794:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4d37c11031f36488 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.986803:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4d37c11031f36488 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788792105.986811:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4d37c11031f36488 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788792105.986818:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788792105.986853:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f36488 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.986859:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788792105.986908:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f36488 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.986916:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c6181363000/0x4d37c11031f36481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f36488 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.986943:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792105.986946:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f3647a expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.986952:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140030c00 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:1.0:1788792105.986954:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4d37c11031f3647a expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.986960:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4d37c11031f3647a expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788792105.986966:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4d37c11031f3647a expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788792105.986972:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788792105.986986:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3647a expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.986992:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788792105.986998:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3647a expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.987004:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c6140030c00/0x4d37c11031f36473 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3647a expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.987018:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792105.987020:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792105.987022:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792105.987029:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788792105.987067:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785837952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788792105.987100:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.987139:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788792105.987145:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785838080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788792105.987164:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792105.987201:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785837952 00000100:00100000:1.0:1788792105.987207:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785837952 00010000:00010000:1.0:1788792105.987228:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c6140031200/0x4d37c11031f36488 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f36481 expref: 24 pid: 22659 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792105.987253:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785838080 00000100:00100000:1.0:1788792105.987257:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785838080 00010000:00010000:1.0:1788792105.987268:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c6141688800/0x4d37c11031f3647a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f36473 expref: 25 pid: 22658 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792105.987278:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788792105.987285:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a140336d-9a80-41e1-97b0-93600c05b204+25:3641:x1875683785837952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788792105.987297:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788792105.987302:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c6140031200/0x4d37c11031f36488 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f36481 expref: 25 pid: 22659 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.987312:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c6140031200/0x4d37c11031f36488 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4d37c11031f36481 expref: 25 pid: 22659 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.987331:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788792105.987473:0:22649:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788792105.987484:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788792105.987499:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a140336d-9a80-41e1-97b0-93600c05b204+25:3641:x1875683785837952:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792105.987507:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788792105.987521:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788792105.987527:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a140336d-9a80-41e1-97b0-93600c05b204+24:3641:x1875683785838080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788792105.987542:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788792105.987547:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c6141688800/0x4d37c11031f3647a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f36473 expref: 24 pid: 22658 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.987556:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c6141688800/0x4d37c11031f3647a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4d37c11031f36473 expref: 24 pid: 22658 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.987568:0:22651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.987576:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788792105.987589:0:22651:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005445943s 00010000:00010000:1.0:1788792105.987592:0:22651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.987599:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.987606:0:22651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.987612:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.987617:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413aa400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792105.987622:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.987627:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.987642:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792105.987653:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788792105.987677:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a140336d-9a80-41e1-97b0-93600c05b204+24:3641:x1875683785838080:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792105.987791:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788792105.987794:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6140031200/0x4d37c11031f36488 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4d37c11031f36481 expref: 24 pid: 22659 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792105.987810:0:22680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875683785837696:0@lo:104: 00010000:00010000:3.0:1788792105.987820:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6141688800/0x4d37c11031f3647a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4d37c11031f36473 expref: 22 pid: 22658 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792105.987820:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785838080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788792105.987828:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785837952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788792105.987830:0:22680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875683785837824:0@lo:104: 00010000:00010000:3.0:1788792105.987848:0:22680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792105.987859:0:22680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792105.987867:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792105.987899:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c61413aa400/0x4d37c11031f365ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788792105.992198:0:24986:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788792105.998107:0:24986:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788792105.998119:0:24986:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788792105.998166:0:24986:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788792105.998222:0:24986:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788792105.998255:0:24986:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788792105.998283:0:24986:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788792105.999091:0:24986:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788792105.999374:0:24986:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788792106.006839:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788792106.518466:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785838208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788792106.518556:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792106.518627:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785838208 00000100:00100000:0.0:1788792106.518636:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785838208 00000100:00100000:0.0:1788792106.518688:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788792106.518698:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785838208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788792106.518752:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788792106.518802:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785838208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792106.518810:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788792106.518861:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785838208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788792106.519121:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785838336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788792106.519155:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792106.519299:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785838336 00000100:00100000:2.0:1788792106.519304:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785838336 00000100:00100000:2.0:1788792106.519346:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788792106.519356:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785838336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788792106.519381:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788792106.519428:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785838336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792106.519434:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788792106.521640:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785838336:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788792107.031991:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788792107.390833:0:25055:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788792107.392338:0:25055:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788792107.415600:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788792107.862608:0:22661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788792107.862620:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c617f976000 from 14 10000000:01000000:1.0:1788792107.862627:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788792107.862726:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141688a00/0x4d37c11031f365f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792107.862739:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c6141688a00/0x4d37c11031f365f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792107.862751:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c6141688a00/0x4d37c11031f365f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792107.862789:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b5dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785838464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788792107.862863:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792107.862960:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6142f47f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788792107.863070:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785838464 00000100:00100000:2.0:1788792107.863081:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785838464 00000100:00100000:2.0:1788792107.863149:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788792107.863159:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+22:22661:x1875683785838464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788792107.863176:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792107.863197:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6174e67c00/0x4d37c11031f365fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f365f4 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792107.863224:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6174e67c00/0x4d37c11031f365fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f365f4 expref: 23 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792107.863243:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6174e67c00/0x4d37c11031f365fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f365f4 expref: 23 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792107.863254:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6174e67c00, rc 0) 00000100:00100000:2.0:1788792107.863311:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+23:22661:x1875683785838464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792107.863317:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788792107.863748:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b5dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785838464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788792107.863779:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c6141688a00/0x4d37c11031f365f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f365fb expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792107.863788:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c6141688a00/0x4d37c11031f365f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f365fb expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792107.863843:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b5dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785838592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788792107.863914:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792107.863947:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6142f47f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788792107.864146:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785838592 00000100:00100000:2.0:1788792107.864153:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785838592 00000100:00100000:2.0:1788792107.864196:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788792107.864203:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+23:22661:x1875683785838592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788792107.864220:0:22658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788792107.864242:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788792107.864245:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788792107.864339:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+23:22661:x1875683785838592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792107.864346:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788792107.865154:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b5dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785838592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788792107.865232:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788792107.865242:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141688a00/0x4d37c11031f365f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f365fb expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792107.865252:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6141688a00/0x4d37c11031f365f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f365fb expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788792107.865263:0:22661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788792107.865267:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c617fa8f000 from 14 10000000:01000000:1.0:1788792107.865269:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788792107.865301:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689e00/0x4d37c11031f36602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792107.865308:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c6141689e00/0x4d37c11031f36602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792107.865324:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c6141689e00/0x4d37c11031f36602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792107.865352:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b5dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785838720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788792107.865396:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792107.865437:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6174cdaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788792107.865508:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785838720 00000100:00100000:0.0:1788792107.865515:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785838720 00000100:00100000:0.0:1788792107.865565:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788792107.865574:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+23:22661:x1875683785838720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788792107.865585:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788792107.865599:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c615086ca00/0x4d37c11031f36609 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f36602 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792107.865622:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c615086ca00/0x4d37c11031f36609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f36602 expref: 24 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792107.865633:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c615086ca00/0x4d37c11031f36609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36602 expref: 24 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792107.865642:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c615086ca00, rc 0) 00000100:00100000:0.0:1788792107.865681:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+24:22661:x1875683785838720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792107.865688:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788792107.866548:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b5dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785838720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788792107.866567:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c6141689e00/0x4d37c11031f36602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36609 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792107.866578:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c6141689e00/0x4d37c11031f36602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f36609 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792107.866633:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b5dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785838848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788792107.866671:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792107.866719:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6174cdaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788792107.867297:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785838848 00000100:00100000:2.0:1788792107.867308:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785838848 00000100:00100000:2.0:1788792107.867383:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788792107.867393:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:22661:x1875683785838848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788792107.867415:0:22658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788792107.867434:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788792107.867437:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788792107.867542:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:22661:x1875683785838848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 150us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792107.867550:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788792107.867704:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b5dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785838848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788792107.868150:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788792107.868162:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6141689e00/0x4d37c11031f36602 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36609 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792107.868172:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6141689e00/0x4d37c11031f36602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36609 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792108.055020:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792109.078394:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792110.102225:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788792110.619797:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788792110.619829:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6174cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785838976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788792110.619935:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792110.619996:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785838976 00000100:00100000:0.0:1788792110.620004:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785838976 00000100:00100000:0.0:1788792110.620065:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788792110.620076:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785838976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788792110.620111:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788792110.620163:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785838976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792110.620172:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788792110.620237:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6174cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785838976:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788792110.621694:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788792110.622767:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785839104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788792110.622831:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792110.624433:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785839104 00000100:00100000:3.0:1788792110.624448:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785839104 00000100:00100000:3.0:1788792110.624517:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788792110.624528:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785839104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788792110.624552:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1788792110.624697:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788792110.634720:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785839104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10180us (11875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792110.634740:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788792110.637381:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785839104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788792111.126376:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788792111.131305:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788792111.131313:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788792111.131316:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c6043732000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788792111.131325:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 748 00000100:00080000:2.0:1788792111.131329:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788792111.131335:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c6043732000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788792111.131359:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043708e00 x1875683785839616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788792111.131391:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788792111.131394:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788792111.131396:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c6043e91000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788792111.131400:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 748 00000100:00080000:2.0:1788792111.131402:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788792111.131405:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c6043e91000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788792111.131415:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c6043708000 x1875683785840128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788792111.131588:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785839360:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.131671:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792111.131735:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785840000:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.131758:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792111.131776:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60427d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875683785840640:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.131799:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792111.131817:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788792111.131822:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a140336d-9a80-41e1-97b0-93600c05b204:3644:1875683785839232:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.131844:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792111.131862:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785839872:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.131907:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792111.131924:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60427d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875683785840512:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.131942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792111.131963:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785839488:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.131984:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792111.132000:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875683785840256:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.132017:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792111.132040:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60427d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875683785840768:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.132060:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792111.132074:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788792111.132079:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785839744:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.132096:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792111.132104:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60427d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875683785840384:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.132119:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792111.132139:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785840000 00000100:00100000:1.0:1788792111.132147:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785840000 00000100:00100000:1.0:1788792111.132197:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785839488 00000100:00100000:1.0:1788792111.132205:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785839488 00000100:00100000:1.0:1788792111.132225:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788792111.132233:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785840000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.132282:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785840000:12345-0@lo:400:kworker.0 Request processed in 49us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792111.132289:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788792111.132302:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788792111.132307:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785839488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.132329:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785839488:12345-0@lo:400:kworker.0 Request processed in 22us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792111.132335:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788792111.132349:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785839232 00000100:00100000:1.0:1788792111.132351:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785839232 00000100:00100000:1.0:1788792111.132373:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788792111.132378:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+24:3644:x1875683785839232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.132403:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+24:3644:x1875683785839232:12345-0@lo:400:kworker.0 Request processed in 25us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792111.132409:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788792111.132433:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785839360 00000100:00100000:1.0:1788792111.132436:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785839360 00000100:00100000:1.0:1788792111.132456:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785839872 00000100:00100000:1.0:1788792111.132459:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785839872 00000100:00100000:1.0:1788792111.132470:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788792111.132476:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785839360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.132507:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785839360:12345-0@lo:400:kworker.0 Request processed in 31us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792111.132512:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788792111.132532:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788792111.132537:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785839872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.132565:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785839872:12345-0@lo:400:kworker.0 Request processed in 28us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792111.132570:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788792111.132590:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785840640 00000100:00100000:1.0:1788792111.132593:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785840640 00000100:00100000:1.0:1788792111.132620:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785840512 00000100:00100000:1.0:1788792111.132623:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785840512 00000100:00100000:1.0:1788792111.132635:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785840256 00000100:00100000:1.0:1788792111.132649:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785840256 00000100:00100000:1.0:1788792111.132663:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785840768 00000100:00100000:1.0:1788792111.132666:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785840768 00000100:00100000:1.0:1788792111.132677:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785839744 00000100:00100000:1.0:1788792111.132680:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785839744 00000100:00100000:1.0:1788792111.132690:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785840384 00000100:00100000:1.0:1788792111.132692:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785840384 00000100:00100000:1.0:1788792111.132706:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788792111.132712:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875683785840640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.132742:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875683785840640:12345-0@lo:400:kworker.0 Request processed in 30us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792111.132748:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788792111.132761:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788792111.132767:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875683785840512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.132792:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875683785840512:12345-0@lo:400:kworker.0 Request processed in 26us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792111.132798:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788792111.132810:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788792111.132815:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875683785840256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.132850:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875683785840256:12345-0@lo:400:kworker.0 Request processed in 35us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792111.132855:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788792111.132867:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788792111.132904:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875683785840768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.132931:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875683785840768:12345-0@lo:400:kworker.0 Request processed in 58us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792111.132937:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788792111.132949:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788792111.132955:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785839744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.132982:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785839744:12345-0@lo:400:kworker.0 Request processed in 27us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792111.132989:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788792111.133000:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788792111.133007:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875683785840384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.133032:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875683785840384:12345-0@lo:400:kworker.0 Request processed in 27us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792111.133038:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788792111.133064:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788792111.133069:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788792111.133097:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6043708380 x1875683785839744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792111.133111:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785839744:0@lo:400:kworker.0 00010000:00080000:1.0:1788792111.133123:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c60427d3b80 x1875683785840384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792111.133144:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60427d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875683785840384:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.133159:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785839488:0@lo:400:kworker.0 00010000:00080000:1.0:1788792111.133170:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6043709c00 x1875683785840256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792111.133177:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875683785840256:0@lo:400:kworker.0 00010000:00080000:1.0:1788792111.133186:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c60427d0e00 x1875683785840768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792111.133193:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60427d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875683785840768:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.133235:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a140336d-9a80-41e1-97b0-93600c05b204:3644:1875683785839232:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.133245:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785839872:0@lo:400:kworker.0 00010000:00080000:1.0:1788792111.133255:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c60427d2300 x1875683785840512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792111.133262:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60427d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875683785840512:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.133270:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785839360:0@lo:400:kworker.0 00000100:00100000:1.0:1788792111.133280:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785840000:0@lo:400:kworker.0 00010000:00080000:1.0:1788792111.133288:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c60427d1180 x1875683785840640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792111.133296:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60427d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875683785840640:0@lo:400:kworker.0 00000100:00100000:0.0:1788792111.133497:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785839616:0@lo:8:kworker.0 00000100:00100000:0.0:1788792111.133538:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792111.133570:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785840128:0@lo:8:kworker.0 00000100:00100000:0.0:1788792111.133590:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792111.133632:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785839616 00000100:00100000:0.0:1788792111.133648:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785839616 00000100:00100000:0.0:1788792111.133671:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785840128 00000100:00100000:0.0:1788792111.133673:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785840128 00000100:00100000:0.0:1788792111.133682:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788792111.133687:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875683785839616:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788792111.133716:0:24171:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 754 last 0 00000020:00000080:0.0:1788792111.133749:0:24171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4d37c11031f36610 00002000:00100000:0.0:1788792111.133765:0:24171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c617dc6a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788792111.133771:0:24171:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788792111.133774:0:24171:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788792111.134016:0:24171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788792111.134043:0:24171:0:(import.c:65:import_set_state_nolock()) ffff8c617dc69000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788792111.134092:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875683785839616:12345-0@lo:8:kworker.0 Request processed in 402us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792111.134099:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788792111.134115:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788792111.134121:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875683785840128:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788792111.134147:0:24171:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 754 last 0 00000020:00000080:0.0:1788792111.134180:0:24171:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4d37c11031f36617 00002000:00100000:0.0:1788792111.134188:0:24171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8c617dc6d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788792111.134191:0:24171:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788792111.134193:0:24171:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788792111.134216:0:24171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788792111.134227:0:24171:0:(import.c:65:import_set_state_nolock()) ffff8c617dc6d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788792111.134254:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1875683785840128:12345-0@lo:8:kworker.0 Request processed in 132us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792111.134260:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788792111.134301:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6043708e00 x1875683785839616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788792136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792111.134309:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788792111.134316:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788792111.134323:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788792111.134328:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788792111.134330:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6043732000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788792111.134344:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788792111.134348:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875683785839616:0@lo:8:kworker.0 00010000:00080000:0.0:1788792111.134360:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6043708000 x1875683785840128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788792136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792111.134366:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788792111.134369:0:3640:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788792111.134374:0:3640:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788792111.134376:0:3640:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788792111.134385:0:3640:0:(import.c:65:import_set_state_nolock()) ffff8c6043e91000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788792111.134394:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788792111.134398:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875683785840128:0@lo:8:kworker.0 00000004:00080000:0.0:1788792111.134449:0:22691:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1788792111.134467:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6174ced880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22691:1875683785841024:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788792111.134495:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792111.134511:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c60437c10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788792111.134523:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6174cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785840896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788792111.134544:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792111.134566:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785841024 00000100:00100000:0.0:1788792111.134570:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785841024 00000100:00100000:0.0:1788792111.134602:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788792111.134609:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22691:x1875683785841024:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1788792111.134909:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788792111.135527:0:22690:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788792111.135615:0:22690:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754152741293ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788792111.135623:0:22690:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788792111.135698:0:23409:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788792111.135722:0:23409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60427d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23409:1875683785841280:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788792111.135783:0:23409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792111.135814:0:23409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6141254540 going to sleep for 11 seconds 00000004:00080000:2.0:1788792111.135829:0:23408:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788792111.135928:0:23408:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 754153053647ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788792111.135935:0:23408:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788792111.135965:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785840896 00000100:00100000:2.0:1788792111.135973:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785840896 00000100:00100000:2.0:1788792111.136020:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788792111.136040:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875683785840896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788792111.136073:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788792111.136130:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875683785840896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792111.136139:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788792111.136654:0:24651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785841280 00000100:00100000:2.0:1788792111.136660:0:24651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785841280 00000100:00100000:2.0:1788792111.136695:0:24651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788792111.136701:0:24651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23409:x1875683785841280:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788792111.136847:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60427d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785841152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788792111.136915:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788792111.136922:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788792111.136959:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785841152 00000100:00100000:2.0:1788792111.136963:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785841152 00000100:00100000:2.0:1788792111.136985:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788792111.136991:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875683785841152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788792111.137002:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00010000:00080000:0.0:1788792111.137044:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6174cef100 x1875683785840896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788792127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792111.137067:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6174cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785840896:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1788792111.138772:0:24171:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788792111.138788:0:24171:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788792111.138797:0:24171:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000100:00100000:2.0:1788792111.139270:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875683785841152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2274us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792111.139284:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788792111.139363:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c60427d0000 x1875683785841152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788792127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788792111.139390:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60427d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785841152:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1788792111.146661:0:22644:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788792111.146719:0:23397:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788792111.165445:0:24651:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788792111.165465:0:24651:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788792111.165658:0:24651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23409:x1875683785841280:12345-0@lo:7:osp-pre-1-1.0 Request processed in 28936us (29855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792111.165670:0:24651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788792111.166326:0:23409:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c60427d2d80 x1875683785841280/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788792127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788792111.166344:0:23409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60427d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23409:1875683785841280:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788792111.166362:0:23409:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788792111.166408:0:23409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60427d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23409:1875683785841408:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788792111.166452:0:23409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792111.166490:0:23409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6174f930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788792111.168268:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785841408 00000100:00100000:2.0:1788792111.168288:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785841408 00000100:00100000:2.0:1788792111.168370:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788792111.168381:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23409:x1875683785841408:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788792111.168428:0:24170:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788792111.168525:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23409:x1875683785841408:12345-0@lo:5:osp-pre-1-1.0 Request processed in 144us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792111.168533:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788792111.168581:0:23409:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c60427d2d80 x1875683785841408/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788792127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788792111.168596:0:23409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60427d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23409:1875683785841408:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788792111.168610:0:23409:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788792111.168665:0:23409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60427d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23409:1875683785841536:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788792111.168702:0:23409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792111.168728:0:23409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6174f930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788792111.169005:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785841536 00000100:00100000:0.0:1788792111.169011:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785841536 00000100:00100000:0.0:1788792111.169052:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788792111.169060:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23409:x1875683785841536:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788792111.169307:0:24172:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:1.0:1788792111.170823:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788792111.170839:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f3661e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.170860:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=754s v=(0 0) 00010000:00010000:1.0:1788792111.170865:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788792111.170891:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f3661e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.170912:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f3661e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.170924:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f3661e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.170932:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f3661e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.170955:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788792111.170968:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792111.170975:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f3661e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.170986:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792111.171002:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f3661e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.171013:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f3661e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.171032:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f3661e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.171040:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f3661e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.171060:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792111.171062:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792111.171064:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788792111.172102:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788792111.172112:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b52285b/0x4d37c11031f36625 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.172125:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=754s v=(0 0) 00010000:00010000:1.0:1788792111.172129:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788792111.172135:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b52285b/0x4d37c11031f36625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.172145:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b52285b/0x4d37c11031f36625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.172153:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b52285b/0x4d37c11031f36625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.172566:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b52285b/0x4d37c11031f36625 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.174713:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788792111.179473:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788792111.179487:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f3662c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.179517:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=754s v=(0 0) 00010000:00010000:1.0:1788792111.179523:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788792111.179530:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f3662c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.179544:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f3662c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.179554:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f3662c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.179562:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f3662c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.182809:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788792111.182831:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b52285b/0x4d37c11031f36625 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.182845:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141688e00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788792111.182850:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b52285b/0x4d37c11031f36625 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.182861:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b52285b/0x4d37c11031f36625 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.182901:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b52285b/0x4d37c11031f36625 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.182910:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b52285b/0x4d37c11031f36625 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.182943:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788792111.182947:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f3662c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.182954:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788792111.182957:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f3662c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.182964:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f3662c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.182986:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f3662c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.182994:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792111.182996:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792111.182999:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792111.191095:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788792111.191113:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f3662c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.193034:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788792111.216235:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.216251:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36633 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.216270:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.216274:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.216281:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36633 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.216297:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36633 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.216306:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36633 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.216314:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36633 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.216333:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788792111.217340:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792111.217350:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36633 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.217363:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e66600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792111.217368:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36633 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.217378:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36633 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.217409:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36633 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.217417:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36633 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.217796:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792111.217799:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792111.217801:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788792111.219724:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.219748:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f3663a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.219765:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.219769:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.219775:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f3663a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.219789:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f3663a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.219799:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f3663a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.219807:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f3663a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.219823:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788792111.220303:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788792111.220311:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f3663a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.220320:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e66400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788792111.220333:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f3663a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.220342:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f3663a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.220359:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f3663a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.220367:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f3663a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.220401:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792111.220403:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792111.220405:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788792111.221613:0:24987:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1788792111.221631:0:24987:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788792111.221648:0:24987:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1788792111.232940:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.232957:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac3c5f84/0x4d37c11031f36641 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.232976:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.232981:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.232988:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3c5f84/0x4d37c11031f36641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.233003:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac3c5f84/0x4d37c11031f36641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.233031:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac3c5f84/0x4d37c11031f36641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.233041:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3c5f84/0x4d37c11031f36641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.233064:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788792111.236843:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.236860:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac3c5f84/0x4d37c11031f36641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.236890:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e67a00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.236895:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac3c5f84/0x4d37c11031f36641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.236908:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac3c5f84/0x4d37c11031f36641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.236962:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac3c5f84/0x4d37c11031f36641 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.236969:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac3c5f84/0x4d37c11031f36641 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.236997:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.236999:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.237001:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788792111.237710:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.237719:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ad8f357/0x4d37c11031f36648 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.237734:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.237739:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.237746:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ad8f357/0x4d37c11031f36648 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.237758:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ad8f357/0x4d37c11031f36648 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.237767:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ad8f357/0x4d37c11031f36648 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.237774:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ad8f357/0x4d37c11031f36648 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.237817:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788792111.238257:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.238264:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d4efa07/0x4d37c11031f3664f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.238274:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.238277:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.238281:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d4efa07/0x4d37c11031f3664f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.238290:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d4efa07/0x4d37c11031f3664f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.238297:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d4efa07/0x4d37c11031f3664f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.238305:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d4efa07/0x4d37c11031f3664f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.238318:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788792111.238649:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788792111.238657:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ad8f357/0x4d37c11031f36648 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.238666:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e67000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.238671:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ad8f357/0x4d37c11031f36648 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.238681:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ad8f357/0x4d37c11031f36648 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.238696:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ad8f357/0x4d37c11031f36648 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.238703:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ad8f357/0x4d37c11031f36648 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.238733:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.238736:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d4efa07/0x4d37c11031f3664f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.238742:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e67200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.238745:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d4efa07/0x4d37c11031f3664f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.238752:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d4efa07/0x4d37c11031f3664f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.238761:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d4efa07/0x4d37c11031f3664f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.238767:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d4efa07/0x4d37c11031f3664f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.238778:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.238780:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.238781:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.238791:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788792111.238922:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.238928:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008446e070/0x4d37c11031f36656 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.238936:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.238944:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.238949:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008446e070/0x4d37c11031f36656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.238958:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008446e070/0x4d37c11031f36656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.238966:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008446e070/0x4d37c11031f36656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.238973:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008446e070/0x4d37c11031f36656 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.238989:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788792111.239733:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23409:x1875683785841536:12345-0@lo:5:osp-pre-1-1.0 Request processed in 70667us (71025us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788792111.239745:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788792111.239801:0:23409:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788792111.239808:0:23409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60427d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23409:1875683785841536:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788792111.239824:0:23409:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1788792111.239897:0:23409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23409:1875683785841664:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788792111.239936:0:23409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792111.240010:0:23409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6043053cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788792111.240041:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785841664 00000100:00100000:1.0:1788792111.240048:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785841664 00000100:00100000:1.0:1788792111.240105:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788792111.240123:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23409:x1875683785841664:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788792111.240312:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23409:x1875683785841664:12345-0@lo:900:osp-pre-1-1.0 Request processed in 190us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792111.240320:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788792111.240350:0:23409:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6043708000 x1875683785841664/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788792127 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792111.240361:0:23409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23409:1875683785841664:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1788792111.240475:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.240483:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008446e070/0x4d37c11031f36656 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.240495:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e66c00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.240508:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008446e070/0x4d37c11031f36656 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.240518:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008446e070/0x4d37c11031f36656 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.240539:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008446e070/0x4d37c11031f36656 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.240547:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008446e070/0x4d37c11031f36656 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.240572:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.240574:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.240576:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788792111.240858:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.240866:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090882d24/0x4d37c11031f3665d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.240904:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.240908:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.240915:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090882d24/0x4d37c11031f3665d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.240927:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090882d24/0x4d37c11031f3665d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.240935:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090882d24/0x4d37c11031f3665d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.240948:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090882d24/0x4d37c11031f3665d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.240969:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788792111.241268:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.241275:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090882d24/0x4d37c11031f3665d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.241284:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e66800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.241289:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090882d24/0x4d37c11031f3665d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.241299:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090882d24/0x4d37c11031f3665d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.241313:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090882d24/0x4d37c11031f3665d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.241328:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090882d24/0x4d37c11031f3665d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.241345:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.241347:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.241349:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788792111.241819:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.241826:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c52d9e/0x4d37c11031f36664 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.241836:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.241840:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.241844:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c52d9e/0x4d37c11031f36664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.241853:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c52d9e/0x4d37c11031f36664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.241860:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c52d9e/0x4d37c11031f36664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.241867:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c52d9e/0x4d37c11031f36664 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.242316:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788792111.245735:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.245751:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040bf99f2/0x4d37c11031f3666b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.245776:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.245781:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.245787:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040bf99f2/0x4d37c11031f3666b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.245801:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040bf99f2/0x4d37c11031f3666b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.245811:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040bf99f2/0x4d37c11031f3666b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.245819:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040bf99f2/0x4d37c11031f3666b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.248890:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788792111.248908:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c52d9e/0x4d37c11031f36664 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.248923:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e67e00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.248929:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c52d9e/0x4d37c11031f36664 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.248941:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c52d9e/0x4d37c11031f36664 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.248963:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c52d9e/0x4d37c11031f36664 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.248971:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c52d9e/0x4d37c11031f36664 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.249001:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.249006:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040bf99f2/0x4d37c11031f3666b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.249032:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e66e00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.249035:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040bf99f2/0x4d37c11031f3666b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.249043:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040bf99f2/0x4d37c11031f3666b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.249052:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040bf99f2/0x4d37c11031f3666b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.249059:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.249061:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.249063:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792111.249179:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788792111.249188:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040bf99f2/0x4d37c11031f3666b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788792111.250005:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.250014:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c95024e1/0x4d37c11031f36672 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.250030:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.250035:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.250043:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c95024e1/0x4d37c11031f36672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.250073:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c95024e1/0x4d37c11031f36672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.250083:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c95024e1/0x4d37c11031f36672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.250157:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c95024e1/0x4d37c11031f36672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.250178:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788792111.251633:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.251658:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000838e295c/0x4d37c11031f36679 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.251677:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.251681:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.251688:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000838e295c/0x4d37c11031f36679 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.251700:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000838e295c/0x4d37c11031f36679 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.251709:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000838e295c/0x4d37c11031f36679 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.251728:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000838e295c/0x4d37c11031f36679 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.251737:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788792111.252150:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788792111.252162:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c95024e1/0x4d37c11031f36672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.252171:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e66200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.252175:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c95024e1/0x4d37c11031f36672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.252184:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c95024e1/0x4d37c11031f36672 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.252203:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c95024e1/0x4d37c11031f36672 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.252218:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c95024e1/0x4d37c11031f36672 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.252242:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.252246:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000838e295c/0x4d37c11031f36679 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.252252:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e67600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.252255:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000838e295c/0x4d37c11031f36679 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.252263:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000838e295c/0x4d37c11031f36679 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.252273:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000838e295c/0x4d37c11031f36679 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.252281:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000838e295c/0x4d37c11031f36679 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.252293:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.252295:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.252297:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.252306:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788792111.253052:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.253061:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f36680 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.253074:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.253078:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.255547:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f36680 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.255588:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f36680 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.255602:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f36680 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.255611:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f36680 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.255716:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788792111.256474:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.256483:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36687 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.256503:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.256508:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.256515:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.256525:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.256534:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.256541:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36687 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.263894:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788792111.263912:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f36680 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.263946:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e66400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.263952:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f36680 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.263964:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f36680 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.263989:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f36680 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.263998:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1cf46e4/0x4d37c11031f36680 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.264030:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.264035:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36687 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.264042:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e66600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.264045:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36687 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.264053:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36687 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.264064:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36687 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.264079:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.264092:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.264095:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.264374:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792111.264404:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788792111.264413:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000383f39e/0x4d37c11031f36687 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788792111.265255:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.265265:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b025e7ae/0x4d37c11031f3668e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.265278:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.265283:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.265289:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b025e7ae/0x4d37c11031f3668e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.265319:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b025e7ae/0x4d37c11031f3668e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.265330:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b025e7ae/0x4d37c11031f3668e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.265339:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b025e7ae/0x4d37c11031f3668e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.265403:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788792111.269139:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.269159:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009639c0d2/0x4d37c11031f36695 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.269176:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.269181:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.269188:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009639c0d2/0x4d37c11031f36695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.269202:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009639c0d2/0x4d37c11031f36695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.269212:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009639c0d2/0x4d37c11031f36695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.269241:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009639c0d2/0x4d37c11031f36695 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.278039:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788792111.278056:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b025e7ae/0x4d37c11031f3668e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.278071:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140031200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.278078:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b025e7ae/0x4d37c11031f3668e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.278102:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b025e7ae/0x4d37c11031f3668e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.278129:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b025e7ae/0x4d37c11031f3668e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.278137:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b025e7ae/0x4d37c11031f3668e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.278163:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.278167:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009639c0d2/0x4d37c11031f36695 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.278174:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140030c00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.278196:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009639c0d2/0x4d37c11031f36695 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.278205:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009639c0d2/0x4d37c11031f36695 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.278215:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009639c0d2/0x4d37c11031f36695 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.278224:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.278225:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.278227:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792111.280230:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788792111.280247:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009639c0d2/0x4d37c11031f36695 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788792111.283339:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.283357:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bb8133b/0x4d37c11031f3669c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.283378:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.283383:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.283390:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bb8133b/0x4d37c11031f3669c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.283407:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bb8133b/0x4d37c11031f3669c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.283418:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bb8133b/0x4d37c11031f3669c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.283426:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bb8133b/0x4d37c11031f3669c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.283461:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788792111.283827:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.283835:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bb8133b/0x4d37c11031f3669c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.283844:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140031600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.283850:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bb8133b/0x4d37c11031f3669c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.283860:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bb8133b/0x4d37c11031f3669c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.283892:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bb8133b/0x4d37c11031f3669c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.283899:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bb8133b/0x4d37c11031f3669c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.283931:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.283933:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.283935:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.283942:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788792111.284175:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788792111.284181:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000890e600c/0x4d37c11031f366a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.284191:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=754s v=(0 0) 00010000:00010000:2.0:1788792111.284194:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788792111.284199:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000890e600c/0x4d37c11031f366a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.284209:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000890e600c/0x4d37c11031f366a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.284218:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000890e600c/0x4d37c11031f366a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.284226:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000890e600c/0x4d37c11031f366a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.284247:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788792111.285389:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.285399:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000890e600c/0x4d37c11031f366a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.285410:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140030000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.285415:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000890e600c/0x4d37c11031f366a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.285434:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000890e600c/0x4d37c11031f366a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.285455:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000890e600c/0x4d37c11031f366a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.285463:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000890e600c/0x4d37c11031f366a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.285486:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.285488:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.285489:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788792111.286131:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788792111.286141:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f366aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.286154:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=754s v=(0 0) 00010000:00010000:1.0:1788792111.286159:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788792111.286165:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f366aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.286178:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f366aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.286189:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f366aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.286198:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f366aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.286222:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788792111.286666:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.286674:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f366aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.286690:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.286694:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f366aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.286702:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f366aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.286717:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f366aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.286725:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004840f773/0x4d37c11031f366aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.286741:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.286743:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.286745:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788792111.286936:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788792111.286942:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f366b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.286953:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=754s v=(0 0) 00010000:00010000:1.0:1788792111.286957:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788792111.286962:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f366b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.286972:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f366b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.286980:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f366b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.286988:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f366b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.287006:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788792111.287896:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.287903:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f366b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.287913:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.287917:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f366b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.287927:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f366b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.287954:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f366b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.287960:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdacff80/0x4d37c11031f366b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.287981:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.287983:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.287985:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788792111.288832:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788792111.288844:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2ce06cd/0x4d37c11031f366b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.288858:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=754s v=(0 0) 00010000:00010000:1.0:1788792111.288862:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788792111.288869:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ce06cd/0x4d37c11031f366b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.290024:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2ce06cd/0x4d37c11031f366b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.290038:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2ce06cd/0x4d37c11031f366b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.290046:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ce06cd/0x4d37c11031f366b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.293698:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788792111.295245:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788792111.295263:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000640016c7/0x4d37c11031f366bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.295283:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=754s v=(0 0) 00010000:00010000:1.0:1788792111.295288:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788792111.295295:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000640016c7/0x4d37c11031f366bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.295310:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000640016c7/0x4d37c11031f366bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.295320:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000640016c7/0x4d37c11031f366bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.295345:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000640016c7/0x4d37c11031f366bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.295468:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788792111.295477:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2ce06cd/0x4d37c11031f366b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.295485:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.295490:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2ce06cd/0x4d37c11031f366b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.295499:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2ce06cd/0x4d37c11031f366b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.295516:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2ce06cd/0x4d37c11031f366b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.295524:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2ce06cd/0x4d37c11031f366b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.295553:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.295557:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000640016c7/0x4d37c11031f366bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.295562:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689c00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.295565:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000640016c7/0x4d37c11031f366bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.295572:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000640016c7/0x4d37c11031f366bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.295581:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000640016c7/0x4d37c11031f366bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.295587:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.295589:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.295590:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792111.297545:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788792111.297559:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000640016c7/0x4d37c11031f366bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788792111.299167:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788792111.299184:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5c77c8b/0x4d37c11031f366c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.299203:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=754s v=(0 0) 00010000:00010000:1.0:1788792111.299208:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788792111.299216:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5c77c8b/0x4d37c11031f366c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.299232:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5c77c8b/0x4d37c11031f366c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.299243:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5c77c8b/0x4d37c11031f366c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.299251:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5c77c8b/0x4d37c11031f366c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.299333:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.299341:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5c77c8b/0x4d37c11031f366c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.299350:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141688200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.299355:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5c77c8b/0x4d37c11031f366c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.299376:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5c77c8b/0x4d37c11031f366c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.299395:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5c77c8b/0x4d37c11031f366c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.299405:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.299407:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.299408:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792111.303947:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788792111.303966:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5c77c8b/0x4d37c11031f366c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788792111.304644:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788792111.304653:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b820ae2/0x4d37c11031f366cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.304669:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=754s v=(0 0) 00010000:00010000:1.0:1788792111.304673:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788792111.304679:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b820ae2/0x4d37c11031f366cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.304695:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b820ae2/0x4d37c11031f366cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.304705:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b820ae2/0x4d37c11031f366cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.304713:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b820ae2/0x4d37c11031f366cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.304792:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.304800:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b820ae2/0x4d37c11031f366cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.304809:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141688800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.304815:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b820ae2/0x4d37c11031f366cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.304824:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b820ae2/0x4d37c11031f366cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.304842:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b820ae2/0x4d37c11031f366cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.304852:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.304853:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.304855:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792111.310251:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788792111.310269:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b820ae2/0x4d37c11031f366cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788792111.312176:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788792111.312189:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e1b9919/0x4d37c11031f366d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.312209:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=754s v=(0 0) 00010000:00010000:1.0:1788792111.312214:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788792111.312221:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e1b9919/0x4d37c11031f366d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.312234:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e1b9919/0x4d37c11031f366d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.312245:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e1b9919/0x4d37c11031f366d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.312253:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e1b9919/0x4d37c11031f366d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.316380:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792111.316400:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e1b9919/0x4d37c11031f366d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.316417:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141688000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792111.316422:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e1b9919/0x4d37c11031f366d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.316434:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e1b9919/0x4d37c11031f366d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.316461:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e1b9919/0x4d37c11031f366d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792111.316631:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788792111.316650:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e1b9919/0x4d37c11031f366d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788792111.318168:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788792111.318181:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff79daf5/0x4d37c11031f366db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.318199:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=754s v=(0 0) 00010000:00010000:0.0:1788792111.318204:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788792111.318211:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff79daf5/0x4d37c11031f366db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.318226:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff79daf5/0x4d37c11031f366db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.318236:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff79daf5/0x4d37c11031f366db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.318244:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff79daf5/0x4d37c11031f366db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.318345:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788792111.318353:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff79daf5/0x4d37c11031f366db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.318361:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086d400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788792111.318379:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff79daf5/0x4d37c11031f366db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.318389:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff79daf5/0x4d37c11031f366db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.318405:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff79daf5/0x4d37c11031f366db lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.318415:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792111.318416:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792111.319162:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792111.319259:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788792111.319268:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff79daf5/0x4d37c11031f366db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788792111.319801:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788792111.319809:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006785f5d3/0x4d37c11031f366e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.319822:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=754s v=(0 0) 00010000:00010000:0.0:1788792111.319833:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788792111.319839:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006785f5d3/0x4d37c11031f366e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.319851:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006785f5d3/0x4d37c11031f366e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.319861:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006785f5d3/0x4d37c11031f366e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.319868:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006785f5d3/0x4d37c11031f366e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792111.319983:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788792111.321030:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788792111.321725:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788792111.321735:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3267f11/0x4d37c11031f366e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.321752:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=754s v=(0 0) 00010000:00010000:0.0:1788792111.321756:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788792111.321763:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3267f11/0x4d37c11031f366e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.321776:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3267f11/0x4d37c11031f366e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.321786:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3267f11/0x4d37c11031f366e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.321802:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3267f11/0x4d37c11031f366e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.321812:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788792111.322177:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788792111.322183:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a606a6/0x4d37c11031f366f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.322192:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=754s v=(0 0) 00010000:00010000:0.0:1788792111.322195:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788792111.322200:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a606a6/0x4d37c11031f366f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.322210:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0a606a6/0x4d37c11031f366f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.322219:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a606a6/0x4d37c11031f366f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.322227:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a606a6/0x4d37c11031f366f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792111.322236:0:24171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:0.0:1788792111.322265:0:24171:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1788792111.322381:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22691:x1875683785841024:12345-0@lo:5:osp-pre-1-0.0 Request processed in 187767us (187880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792111.322397:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788792111.323589:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788792111.323604:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006785f5d3/0x4d37c11031f366e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323617:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086d800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788792111.323622:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006785f5d3/0x4d37c11031f366e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323643:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006785f5d3/0x4d37c11031f366e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323665:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006785f5d3/0x4d37c11031f366e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323673:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006785f5d3/0x4d37c11031f366e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323718:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788792111.323722:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3267f11/0x4d37c11031f366e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323728:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086d200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788792111.323731:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3267f11/0x4d37c11031f366e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323740:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3267f11/0x4d37c11031f366e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323750:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3267f11/0x4d37c11031f366e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323758:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3267f11/0x4d37c11031f366e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323770:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788792111.323773:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0a606a6/0x4d37c11031f366f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323780:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086c400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788792111.323783:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a606a6/0x4d37c11031f366f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323802:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a606a6/0x4d37c11031f366f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323813:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0a606a6/0x4d37c11031f366f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323820:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0a606a6/0x4d37c11031f366f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792111.323834:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792111.323836:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792111.323838:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788792111.323970:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6174ced880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22691:1875683785841024:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788792111.323988:0:22691:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1788792111.324040:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6174ced880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22691:1875683785841792:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788792111.324627:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792111.324783:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b3840 going to sleep for 11 seconds 00000100:00100000:0.0:1788792111.324809:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785841792 00000100:00100000:0.0:1788792111.324817:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785841792 00010000:00010000:1.0:1788792111.324926:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788792111.328545:0:24651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788792111.328572:0:24651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22691:x1875683785841792:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788792111.328653:0:24651:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1788792111.331468:0:24651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22691:x1875683785841792:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2902us (6836us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788792111.331481:0:24651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788792111.331811:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6174ced880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22691:1875683785841792:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788792111.331830:0:22691:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:0.0:1788792111.643998:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6174cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785841920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788792111.644075:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792111.644220:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6174cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785842048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788792111.644262:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792111.644297:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785841920 00000100:00100000:0.0:1788792111.644305:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785841920 00000100:00100000:0.0:1788792111.644348:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785842048 00000100:00100000:0.0:1788792111.644351:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785842048 00000100:00100000:0.0:1788792111.644365:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788792111.644374:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785841920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788792111.644410:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788792111.644457:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785841920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792111.644463:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788792111.644481:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788792111.644488:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785842048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788792111.644505:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788792111.644545:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785842048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792111.644551:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788792111.644600:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6174cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785842048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788792111.644625:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6174cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785841920:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788792112.151702:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788792112.790573:0:23423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788792113.183166:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792114.205947:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788792114.352717:0:25345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788792115.224217:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788792115.729439:0:25398:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788792115.730652:0:25398:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788792115.734421:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788792115.734450:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60427d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785842304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788792115.734543:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792115.734626:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785842304 00000100:00100000:2.0:1788792115.734648:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785842304 00000100:00100000:2.0:1788792115.734704:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788792115.734714:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785842304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788792115.734765:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788792115.734819:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785842304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792115.734827:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788792115.734857:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788792115.734925:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60427d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785842304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788792115.735275:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785842176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788792115.735310:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792115.738832:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785842176 00000100:00100000:2.0:1788792115.738846:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785842176 00000100:00100000:2.0:1788792115.738944:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788792115.738956:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785842176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788792115.738993:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788792115.739102:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785842176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (3790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792115.739110:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788792115.739135:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788792115.739178:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785842176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788792116.247648:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785842816:0@lo:400:kworker.0 00000100:00100000:3.0:1788792116.247741:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792116.247823:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785843328:0@lo:400:kworker.0 00000100:00100000:3.0:1788792116.247845:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792116.247864:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875683785843840:0@lo:400:kworker.0 00000100:00100000:3.0:1788792116.248194:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792116.248223:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788792116.248238:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785842432:0@lo:400:kworker.0 00000100:00100000:3.0:1788792116.248340:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792116.248378:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875683785842944:0@lo:400:kworker.0 00000100:00100000:3.0:1788792116.248399:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792116.248413:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875683785843456:0@lo:400:kworker.0 00000100:00100000:3.0:1788792116.248433:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792116.248450:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c614354ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875683785843968:0@lo:400:kworker.0 00000100:00100000:3.0:1788792116.248474:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792116.248507:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785842688:0@lo:400:kworker.0 00000100:00100000:3.0:1788792116.248532:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792116.248565:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785843200:0@lo:400:kworker.0 00000100:00100000:3.0:1788792116.248588:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792116.248607:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875683785843712:0@lo:400:kworker.0 00000100:00100000:3.0:1788792116.248628:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792116.248641:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788792116.248648:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785842560:0@lo:400:kworker.0 00000100:00100000:3.0:1788792116.248672:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792116.248687:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785843072:0@lo:400:kworker.0 00000100:00100000:3.0:1788792116.248707:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792116.248721:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875683785843584:0@lo:400:kworker.0 00000100:00100000:3.0:1788792116.248741:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792116.248768:0:24651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785842816 00000100:00100000:3.0:1788792116.248776:0:24651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785842816 00000100:00100000:3.0:1788792116.248838:0:24651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785843328 00000100:00100000:3.0:1788792116.248841:0:24651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785843328 00000100:00100000:3.0:1788792116.248868:0:24651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785842688 00000100:00100000:0.0:1788792116.249303:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785842432 00000100:00100000:0.0:1788792116.249308:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785842432 00000100:00100000:0.0:1788792116.249358:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788792116.249369:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+24:3643:x1875683785842432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792116.249442:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+24:3643:x1875683785842432:12345-0@lo:400:kworker.0 Request processed in 74us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792116.249450:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788792116.249486:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785843840 00000100:00100000:0.0:1788792116.249490:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785843840 00000100:00100000:0.0:1788792116.249509:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785842944 00000100:00100000:0.0:1788792116.249512:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785842944 00000100:00100000:0.0:1788792116.249522:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785843456 00000100:00100000:0.0:1788792116.249524:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785843456 00000100:00100000:0.0:1788792116.249534:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785843968 00000100:00100000:0.0:1788792116.249536:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785843968 00000100:00100000:0.0:1788792116.249563:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785843712 00000100:00100000:0.0:1788792116.249566:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785843712 00000100:00100000:0.0:1788792116.249578:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785843584 00000100:00100000:0.0:1788792116.249581:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785843584 00000100:00100000:0.0:1788792116.249594:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788792116.249601:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875683785843840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792116.249661:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875683785843840:12345-0@lo:400:kworker.0 Request processed in 61us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792116.249668:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788792116.249679:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788792116.249685:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875683785842944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792116.249709:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875683785842944:12345-0@lo:400:kworker.0 Request processed in 24us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792116.249714:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788792116.249724:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788792116.249729:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875683785843456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792116.249750:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875683785843456:12345-0@lo:400:kworker.0 Request processed in 22us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792116.249755:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788792116.249765:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788792116.249771:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875683785843968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792116.249796:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875683785843968:12345-0@lo:400:kworker.0 Request processed in 26us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792116.249801:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788792116.249811:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788792116.249817:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875683785843712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792116.249848:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875683785843712:12345-0@lo:400:kworker.0 Request processed in 31us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792116.249853:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788792116.249861:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788792116.249866:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875683785843584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792116.249927:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875683785843584:12345-0@lo:400:kworker.0 Request processed in 61us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792116.249933:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788792116.249965:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785842560 00000100:00100000:0.0:1788792116.249968:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785842560 00000100:00100000:0.0:1788792116.249993:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785843072 00000100:00100000:0.0:1788792116.250313:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785843072 00000100:00100000:0.0:1788792116.250337:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788792116.250343:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785842560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792116.250381:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785842560:12345-0@lo:400:kworker.0 Request processed in 39us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792116.250386:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788792116.250396:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788792116.250402:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785843072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792116.250428:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785843072:12345-0@lo:400:kworker.0 Request processed in 27us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792116.250434:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788792116.250546:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785842432:0@lo:400:kworker.0 00010000:00080000:0.0:1788792116.250583:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6043f51880 x1875683785842944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792116.250598:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875683785842944:0@lo:400:kworker.0 00010000:00080000:0.0:1788792116.250612:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6043c49f80 x1875683785843456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792116.250621:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875683785843456:0@lo:400:kworker.0 00010000:00080000:0.0:1788792116.250662:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c614354ed80 x1875683785843968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792116.250671:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c614354ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875683785843968:0@lo:400:kworker.0 00010000:00080000:0.0:1788792116.250683:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6043c4a300 x1875683785843840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792116.250691:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875683785843840:0@lo:400:kworker.0 00000100:00100000:0.0:1788792116.250740:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785842560:0@lo:400:kworker.0 00000100:00100000:0.0:1788792116.250752:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785843072:0@lo:400:kworker.0 00010000:00080000:0.0:1788792116.250763:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6043c4ad80 x1875683785843584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792116.250772:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875683785843584:0@lo:400:kworker.0 00010000:00080000:0.0:1788792116.250793:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c6043c48a80 x1875683785843712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792116.250802:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875683785843712:0@lo:400:kworker.0 00000100:00100000:1.0:1788792116.251205:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785843200 00000100:00100000:1.0:1788792116.251211:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785843200 00000100:00100000:1.0:1788792116.251243:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788792116.251263:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875683785842816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792116.251331:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875683785842816:12345-0@lo:400:kworker.0 Request processed in 80us (3590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792116.251338:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788792116.251356:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788792116.251362:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785843328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792116.251389:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785843328:12345-0@lo:400:kworker.0 Request processed in 28us (3543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792116.251394:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788792116.251405:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788792116.251412:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785843200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792116.251439:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785843200:12345-0@lo:400:kworker.0 Request processed in 29us (2851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792116.251445:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788792116.252139:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785844224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788792116.252195:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792116.252272:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785843200:0@lo:400:kworker.0 00000100:00100000:2.0:1788792116.252296:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788792116.252302:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c604370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785844096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788792116.252327:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792116.252374:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785844224 00000100:00100000:2.0:1788792116.252381:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785844224 00000100:00100000:2.0:1788792116.252410:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785844096 00000100:00100000:2.0:1788792116.252413:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785844096 00000100:00100000:2.0:1788792116.252425:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788792116.252433:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875683785844224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788792116.252462:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788792116.252503:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875683785844224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792116.252509:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788792116.252523:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788792116.252529:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785844096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788792116.252538:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788792116.252575:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785844096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792116.252581:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788792116.252609:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785844096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788792116.252632:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c604370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785844224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788792116.252754:0:24651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785842688 00000100:00100000:3.0:1788792116.252790:0:24651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788792116.252798:0:24651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785842688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792116.252839:0:24651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785842688:12345-0@lo:400:kworker.0 Request processed in 43us (4307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792116.252846:0:24651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788792116.252904:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788792116.252910:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788792116.252913:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788792116.252923:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788792116.253102:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785842816:0@lo:400:kworker.0 00000100:00100000:0.0:1788792116.253115:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785843328:0@lo:400:kworker.0 00000100:00100000:2.0:1788792116.253399:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785842688:0@lo:400:kworker.0 00000100:00100000:2.0:1788792116.758146:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788792116.758168:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60427d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785844352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788792116.758239:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792116.758295:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785844352 00000100:00100000:2.0:1788792116.758304:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785844352 00000100:00100000:2.0:1788792116.758375:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788792116.758385:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785844352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788792116.758429:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788792116.758473:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785844352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792116.758480:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788792116.758525:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60427d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785844352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788792116.762305:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788792116.762348:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6174cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785844480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788792116.762451:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792116.762697:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785844480 00000100:00100000:1.0:1788792116.762709:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785844480 00000100:00100000:1.0:1788792116.762781:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788792116.762794:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785844480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788792116.762853:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788792116.762944:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785844480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792116.762953:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788792116.763033:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6174cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785844480:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1788792116.768359:0:24987:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000020:00000004:2.0:1788792116.951604:0:25448:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788792116.952141:0:25448:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788792117.284142:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788792117.450435:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792117.450574:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760556288 00000100:00100000:1.0:1788792117.450587:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760556288 00000100:00100000:1.0:1788792117.450647:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 116 00000100:00100000:1.0:1788792117.450658:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2418:x1875683760556288:12345-192.168.201.20@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788792117.450691:0:22658:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 55156022-243d-49cf-9038-3cfcecfd35e3@192.168.201.20@tcp t0 exp 0000000000000000 cur 760 last 0 00000020:00000080:1.0:1788792117.450736:0:22658:0:(genops.c:1385:class_connect()) connect: client 55156022-243d-49cf-9038-3cfcecfd35e3, cookie 0x4d37c11031f366f7 00000100:00080000:1.0:1788792117.450952:0:22658:0:(import.c:65:import_set_state_nolock()) ffff8c604336a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788792117.451042:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+5:2418:x1875683760556288:12345-192.168.201.20@tcp:250:mount.lustre.0 Request processed in 383us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792117.451050:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 116 00000100:00100000:1.0:1788792117.453275:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792117.453383:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760556416 00000100:00100000:0.0:1788792117.453393:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760556416 00000100:00100000:0.0:1788792117.453451:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 117 00000100:00100000:0.0:1788792117.453462:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+5:18086:x1875683760556416:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788792117.453496:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788792117.453517:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c615086d600/0x4d37c11031f366fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67569 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792117.453572:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c615086d600/0x4d37c11031f366fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67569 expref: 6 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792117.453584:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c615086d600/0x4d37c11031f366fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67569 expref: 6 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792117.453593:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c615086d600, rc 0) 00000100:00100000:0.0:1788792117.453662:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+6:18086:x1875683760556416:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 202us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792117.453670:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 117 00000100:00100000:3.0:1788792117.455494:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792117.456904:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760556544 00000100:00100000:1.0:1788792117.456918:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760556544 00000100:00100000:1.0:1788792117.457001:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 118 00000100:00100000:1.0:1788792117.457012:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+6:18086:x1875683760556544:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788792117.457165:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+6:18086:x1875683760556544:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 154us (1680us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788792117.457173:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 118 00000100:00100000:3.0:1788792117.465572:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792117.465850:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760556672 00000100:00100000:1.0:1788792117.465863:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760556672 00000100:00100000:1.0:1788792117.465967:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:1.0:1788792117.465991:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+6:18086:x1875683760556672:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788792117.466014:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788792117.466037:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6141688c00/0x4d37c11031f36705 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67570 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792117.466094:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6141688c00/0x4d37c11031f36705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67570 expref: 7 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792117.466108:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6141688c00/0x4d37c11031f36705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67570 expref: 7 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792117.466119:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6141688c00, rc 0) 00000100:00100000:1.0:1788792117.466204:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+7:18086:x1875683760556672:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 227us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792117.466211:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:1.0:1788792117.478260:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792117.480358:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760556800 00000100:00100000:0.0:1788792117.480374:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760556800 00000100:00100000:0.0:1788792117.480463:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:0.0:1788792117.480477:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+7:18086:x1875683760556800:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788792117.480951:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+8:18086:x1875683760556800:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 475us (2698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792117.480960:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:3.0:1788792117.495675:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792117.495857:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760556928 00000100:00100000:2.0:1788792117.495868:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760556928 00000100:00100000:2.0:1788792117.495969:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 121 00000100:00100000:2.0:1788792117.495990:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+8:18086:x1875683760556928:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788792117.496181:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+8:18086:x1875683760556928:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 202us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792117.496192:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 121 00000100:00100000:3.0:1788792117.500473:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792117.505395:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760557056 00000100:00100000:0.0:1788792117.505417:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760557056 00000100:00100000:0.0:1788792117.505505:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 122 00000100:00100000:0.0:1788792117.505520:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+8:18105:x1875683760557056:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788792117.516109:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+8:18105:x1875683760557056:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 10577us (15631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792117.516127:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 122 00000100:00100000:0.0:1788792117.555820:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792117.556074:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760557184 00000100:00100000:3.0:1788792117.556089:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760557184 00000100:00100000:3.0:1788792117.556160:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 123 00000100:00100000:3.0:1788792117.556171:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+8:18105:x1875683760557184:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788792117.556355:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+8:18105:x1875683760557184:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 185us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792117.556375:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 123 00000100:00100000:3.0:1788792117.564794:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792117.564915:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760557312 00000100:00100000:2.0:1788792117.564928:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760557312 00000100:00100000:2.0:1788792117.564996:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 124 00000100:00100000:2.0:1788792117.565008:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+8:18105:x1875683760557312:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788792117.565202:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+8:18105:x1875683760557312:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 195us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792117.565210:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 124 00000100:00100000:0.0:1788792117.577552:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792117.577673:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760557440 00000100:00100000:2.0:1788792117.577709:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760557440 00000100:00100000:2.0:1788792117.577779:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:2.0:1788792117.577792:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+8:18086:x1875683760557440:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788792117.577815:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792117.577836:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6140031600/0x4d37c11031f3670c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c675a1 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792117.577920:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6140031600/0x4d37c11031f3670c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675a1 expref: 9 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792117.577933:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6140031600/0x4d37c11031f3670c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675a1 expref: 9 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792117.577944:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140031600, rc 0) 00000100:00100000:2.0:1788792117.578196:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+9:18086:x1875683760557440:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 406us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792117.578203:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:0.0:1788792117.581469:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792117.581571:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760557568 00000100:00100000:3.0:1788792117.581585:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760557568 00000100:00100000:3.0:1788792117.581646:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 126 00000100:00100000:3.0:1788792117.581657:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+9:18086:x1875683760557568:12345-192.168.201.20@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788792117.581681:0:22658:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788792117.581716:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788792117.581720:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788792117.581723:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788792117.581726:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788792117.581728:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788792117.591338:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+9:18086:x1875683760557568:12345-192.168.201.20@tcp:256:mount.lustre.0 Request processed in 9289us (9486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792117.591361:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 126 00000100:00100000:0.0:1788792117.599763:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792117.600103:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760557696 00000100:00100000:2.0:1788792117.600117:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760557696 00000100:00100000:2.0:1788792117.600198:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 127 00000100:00100000:2.0:1788792117.600210:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61486f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+9:18086:x1875683760557696:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788792117.600228:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792117.600248:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6140030000/0x4d37c11031f36713 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c675a8 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792117.600284:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6140030000/0x4d37c11031f36713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675a8 expref: 10 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792117.600298:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6140030000/0x4d37c11031f36713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675a8 expref: 10 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792117.600325:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140030000, rc 0) 00000100:00100000:2.0:1788792117.600405:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61486f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+10:18086:x1875683760557696:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 197us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792117.600414:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 127 00000100:00100000:0.0:1788792117.607645:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792117.607822:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760557824 00000100:00100000:1.0:1788792117.607835:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760557824 00000100:00100000:1.0:1788792117.607939:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 128 00000100:00100000:1.0:1788792117.607952:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+10:18086:x1875683760557824:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788792117.608610:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+10:18086:x1875683760557824:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 656us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792117.608619:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 128 00000100:00100000:0.0:1788792117.612392:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792117.612699:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760557952 00000100:00100000:3.0:1788792117.612712:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760557952 00000100:00100000:3.0:1788792117.612782:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 129 00000100:00100000:3.0:1788792117.612797:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+10:18086:x1875683760557952:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788792117.613709:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+10:18086:x1875683760557952:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 910us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792117.613722:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 129 00000100:00100000:0.0:1788792117.617953:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792117.618074:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760558080 00000100:00100000:2.0:1788792117.618088:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760558080 00000100:00100000:2.0:1788792117.618149:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 130 00000100:00100000:2.0:1788792117.618163:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+10:18109:x1875683760558080:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788792117.618364:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+10:18109:x1875683760558080:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 203us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792117.618372:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 130 00000100:00100000:0.0:1788792117.637207:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792117.639912:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760558208 00000100:00100000:2.0:1788792117.639935:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760558208 00000100:00100000:2.0:1788792117.640048:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 131 00000100:00100000:2.0:1788792117.640062:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604316a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+10:18109:x1875683760558208:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788792117.640273:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604316a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+10:18109:x1875683760558208:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 214us (3085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792117.640282:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 131 00000100:00100000:0.0:1788792117.662027:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792117.662135:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792117.662174:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760558336 00000100:00100000:0.0:1788792117.662605:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760558336 00000100:00100000:0.0:1788792117.662650:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760558592 00000100:00100000:0.0:1788792117.662654:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760558592 00000100:00100000:0.0:1788792117.662675:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1788792117.662684:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2418:x1875683760558336:12345-192.168.201.20@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788792117.662726:0:22665:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f7fc150c-125b-4591-9e6f-98bd2b6bdc11@192.168.201.20@tcp t0 exp 0000000000000000 cur 760 last 0 00000020:00000080:0.0:1788792117.662785:0:22665:0:(genops.c:1385:class_connect()) connect: client f7fc150c-125b-4591-9e6f-98bd2b6bdc11, cookie 0x4d37c11031f3671a 00000004:00100000:0.0:1788792117.662816:0:22665:0:(mdt_handler.c:7331:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788792117.662986:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:3.0:1788792117.662995:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2418:x1875683760558592:12345-192.168.201.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788792117.663014:0:22666:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f7fc150c-125b-4591-9e6f-98bd2b6bdc11@192.168.201.20@tcp t0 exp 0000000000000000 cur 760 last 0 00000020:00000080:3.0:1788792117.663052:0:22666:0:(genops.c:1385:class_connect()) connect: client f7fc150c-125b-4591-9e6f-98bd2b6bdc11, cookie 0x4d37c11031f36721 00000004:00100000:3.0:1788792117.663066:0:22666:0:(mdt_handler.c:7331:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000040:00080000:1.0:1788792117.664356:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1788792117.667098:0:22665:0:(import.c:65:import_set_state_nolock()) ffff8c617dc6f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788792117.667803:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:2418:x1875683760558336:12345-192.168.201.20@tcp:38:mount.lustre.0 Request processed in 5113us (5785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792117.667814:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:3.0:1788792117.671566:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792117.671610:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792117.671701:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760558848 00000100:00100000:1.0:1788792117.671712:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760558848 00000100:00100000:1.0:1788792117.671784:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760558464 00000100:00100000:1.0:1788792117.671788:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760558464 00000100:00100000:1.0:1788792117.671827:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:1.0:1788792117.671837:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:18086:x1875683760558848:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788792117.671910:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00080000:3.0:1788792117.672052:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788792117.672172:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:18086:x1875683760558848:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 335us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792117.672180:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:1.0:1788792117.672286:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:1.0:1788792117.672294:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:0:x1875683760558464:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788792117.672307:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788792117.672332:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:0:x1875683760558464:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 39us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792117.672339:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00080000:2.0:1788792117.673776:0:22666:0:(import.c:65:import_set_state_nolock()) ffff8c617dcb9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788792117.673859:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:2418:x1875683760558592:12345-192.168.201.20@tcp:38:mount.lustre.0 Request processed in 10858us (11718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792117.673902:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:3.0:1788792117.674868:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792117.675066:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760558976 00000100:00100000:0.0:1788792117.675074:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760558976 00000100:00100000:0.0:1788792117.675129:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:0.0:1788792117.675138:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:18086:x1875683760558976:12345-192.168.201.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788792117.675215:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:18086:x1875683760558976:12345-192.168.201.20@tcp:40:mount.lustre.0 Request processed in 78us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792117.675229:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:1.0:1788792117.679331:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792117.680045:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760559360 00000100:00100000:3.0:1788792117.680059:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760559360 00000100:00100000:3.0:1788792117.680125:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:3.0:1788792117.680137:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:18086:x1875683760559360:12345-192.168.201.20@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788792117.680248:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:18086:x1875683760559360:12345-192.168.201.20@tcp:900:mount.lustre.0 Request processed in 112us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792117.680257:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:3.0:1788792117.680312:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792117.680421:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792117.680443:0:24651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760559104 00000100:00100000:3.0:1788792117.680446:0:24651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760559104 00000100:00100000:3.0:1788792117.680465:0:24651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760559232 00000100:00100000:3.0:1788792117.680467:0:24651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760559232 00000100:00100000:3.0:1788792117.680483:0:24651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:3.0:1788792117.680489:0:24651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2418:x1875683760559104:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788792117.680520:0:24651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f7fc150c-125b-4591-9e6f-98bd2b6bdc11@192.168.201.20@tcp t0 exp 0000000000000000 cur 760 last 0 00000020:00000080:3.0:1788792117.680560:0:24651:0:(genops.c:1385:class_connect()) connect: client f7fc150c-125b-4591-9e6f-98bd2b6bdc11, cookie 0x4d37c11031f36728 00002000:00100000:3.0:1788792117.680573:0:24651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f7fc150c-125b-4591-9e6f-98bd2b6bdc11/ffff8c60424bf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788792117.680592:0:24651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788792117.680786:0:24651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788792117.680816:0:24651:0:(import.c:65:import_set_state_nolock()) ffff8c60424b9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788792117.680858:0:24651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:2418:x1875683760559104:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 367us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792117.680866:0:24651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:3.0:1788792117.680917:0:24651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:3.0:1788792117.680923:0:24651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c614354ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2418:x1875683760559232:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788792117.680956:0:24651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f7fc150c-125b-4591-9e6f-98bd2b6bdc11@192.168.201.20@tcp t0 exp 0000000000000000 cur 760 last 0 00000020:00000080:3.0:1788792117.680975:0:24651:0:(genops.c:1385:class_connect()) connect: client f7fc150c-125b-4591-9e6f-98bd2b6bdc11, cookie 0x4d37c11031f3672f 00002000:00100000:3.0:1788792117.680980:0:24651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f7fc150c-125b-4591-9e6f-98bd2b6bdc11/ffff8c60424b8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788792117.680986:0:24651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788792117.681123:0:24651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788792117.681142:0:24651:0:(import.c:65:import_set_state_nolock()) ffff8c60424ba800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788792117.681168:0:24651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c614354ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:2418:x1875683760559232:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 243us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792117.681175:0:24651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:0.0:1788792117.699398:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792117.699611:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792117.702999:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760558720 00000100:00100000:1.0:1788792117.703023:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760558720 00000100:00100000:1.0:1788792117.703145:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:1.0:1788792117.703158:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:0:x1875683760558720:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788792117.703211:0:24649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788792117.703327:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:0:x1875683760558720:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 171us (3715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792117.703336:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00080000:3.0:1788792117.704475:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788792117.708478:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760559488 00000100:00100000:0.0:1788792117.708501:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760559488 00000100:00100000:0.0:1788792117.708739:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:0.0:1788792117.708753:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:18086:x1875683760559488:12345-192.168.201.20@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788792117.715106:0:22667:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6242us 00000004:00200000:3.0:1788792117.742576:0:22667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788792117.742918:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:18086:x1875683760559488:12345-192.168.201.20@tcp:33:mount.lustre.0 Request processed in 34160us (43527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792117.742934:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:0.0:1788792117.959045:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792117.959489:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760559616 00000100:00100000:1.0:1788792117.959507:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760559616 00000100:00100000:1.0:1788792117.959658:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:1.0:1788792117.959704:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6174cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:18132:x1875683760559616:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:1.0:1788792117.959745:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788792117.959777:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f36736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c675d9 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792117.959854:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689600/0x4d37c11031f3673d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792117.959868:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689600/0x4d37c11031f3673d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792117.959908:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689600/0x4d37c11031f3673d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788792117.960174:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788792117.960180:0:22664:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788792117.960233:0:22664:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689600/0x4d37c11031f3673d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792117.960266:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f36736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675d9 expref: 8 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792117.960287:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689600/0x4d37c11031f3673d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675d9 expref: 7 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792117.960297:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6042484400) 00010000:00010000:1.0:1788792117.960300:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788792117.960304:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6141689600, rc 0) 00000100:00100000:1.0:1788792117.960399:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6174cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:18132:x1875683760559616:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 700us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792117.960418:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00010000:00010000:3.0:1788792118.294284:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792119.318400:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792120.342955:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788792120.347084:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792120.347187:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760559744 00000100:00100000:0.0:1788792120.347198:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760559744 00000100:00100000:0.0:1788792120.347285:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:0.0:1788792120.347296:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:18185:x1875683760559744:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:0.0:1788792120.347343:0:24649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788792120.347460:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:18185:x1875683760559744:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 165us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792120.347468:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00080000:3.0:1788792120.347916:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788792120.359020:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792120.360292:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760559872 00000100:00100000:2.0:1788792120.360308:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760559872 00000100:00100000:2.0:1788792120.360405:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:2.0:1788792120.360418:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:18185:x1875683760559872:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788792120.360463:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788792120.360578:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:18185:x1875683760559872:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 163us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792120.360586:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00080000:3.0:1788792120.360731:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788792120.367375:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792120.367580:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760560000 00000100:00100000:0.0:1788792120.367593:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760560000 00000100:00100000:0.0:1788792120.367786:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:0.0:1788792120.367799:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:18185:x1875683760560000:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788792120.367986:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788792120.368106:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:18185:x1875683760560000:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 309us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792120.368114:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00080000:3.0:1788792120.369357:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788792120.371440:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792120.371624:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760560128 00000100:00100000:1.0:1788792120.371636:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760560128 00000100:00100000:1.0:1788792120.371721:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:1.0:1788792120.371733:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:18185:x1875683760560128:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788792120.371774:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788792120.371953:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:18185:x1875683760560128:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 221us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792120.371961:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00080000:3.0:1788792120.372317:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788792120.598032:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792120.598284:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760560256 00000100:00100000:3.0:1788792120.598298:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760560256 00000100:00100000:3.0:1788792120.598369:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 132 00000100:00100000:3.0:1788792120.598382:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604316ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+10:18216:x1875683760560256:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788792120.598401:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792120.598441:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c61413aa400/0x4d37c11031f36744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c675e0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792120.598482:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c61413aa400/0x4d37c11031f36744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675e0 expref: 11 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792120.598497:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c61413aa400/0x4d37c11031f36744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675e0 expref: 11 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792120.598506:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c61413aa400, rc 0) 00000100:00100000:3.0:1788792120.598586:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604316ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+11:18216:x1875683760560256:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 207us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792120.598594:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 132 00000100:00100000:2.0:1788792120.612962:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792120.613080:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760560384 00000100:00100000:0.0:1788792120.613092:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760560384 00000100:00100000:0.0:1788792120.613169:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 133 00000100:00100000:0.0:1788792120.613181:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604316b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+11:18216:x1875683760560384:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788792120.613377:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604316b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+11:18216:x1875683760560384:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 197us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792120.613386:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 133 00000100:00100000:0.0:1788792120.632403:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792120.632553:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760560512 00000100:00100000:2.0:1788792120.632567:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760560512 00000100:00100000:2.0:1788792120.632633:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 134 00000100:00100000:2.0:1788792120.633414:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+11:18216:x1875683760560512:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788792120.633629:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+11:18216:x1875683760560512:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 228us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792120.633638:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 134 00000100:00100000:1.0:1788792120.665717:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792120.665852:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760560640 00000100:00100000:3.0:1788792120.665870:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760560640 00000100:00100000:3.0:1788792120.665992:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 135 00000100:00100000:3.0:1788792120.666006:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+11:18223:x1875683760560640:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788792120.666224:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+11:18223:x1875683760560640:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 219us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792120.666234:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 135 00000100:00100000:0.0:1788792120.724102:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792120.727703:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760560768 00000100:00100000:2.0:1788792120.727727:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760560768 00000100:00100000:2.0:1788792120.727818:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 136 00000100:00100000:2.0:1788792120.727831:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+11:18223:x1875683760560768:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788792120.728071:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+11:18223:x1875683760560768:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 241us (3980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792120.728080:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 136 00000100:00100000:1.0:1788792120.749286:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792120.749930:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760560896 00000100:00100000:3.0:1788792120.749944:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760560896 00000100:00100000:3.0:1788792120.750018:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 137 00000100:00100000:3.0:1788792120.750031:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+11:18223:x1875683760560896:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788792120.750208:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+11:18223:x1875683760560896:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 179us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792120.750217:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 137 00000100:00100000:1.0:1788792120.759956:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792120.760065:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760561024 00000100:00100000:0.0:1788792120.760078:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760561024 00000100:00100000:0.0:1788792120.760157:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 138 00000100:00100000:0.0:1788792120.760178:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+11:18216:x1875683760561024:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788792120.760200:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788792120.760223:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c615086ce00/0x4d37c11031f3674b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67611 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792120.760259:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c615086ce00/0x4d37c11031f3674b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67611 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792120.760272:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c615086ce00/0x4d37c11031f3674b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67611 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792120.760282:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c615086ce00, rc 0) 00000100:00100000:0.0:1788792120.760353:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+12:18216:x1875683760561024:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 187us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792120.760361:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 138 00000100:00100000:0.0:1788792120.790961:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792120.791807:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760561152 00000100:00100000:2.0:1788792120.791823:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760561152 00000100:00100000:2.0:1788792120.791940:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 139 00000100:00100000:2.0:1788792120.791952:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+12:18216:x1875683760561152:12345-192.168.201.20@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788792120.791987:0:22659:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788792120.792016:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788792120.792022:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788792120.792026:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788792120.792029:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788792120.792032:0:22659:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788792120.803127:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+12:18216:x1875683760561152:12345-192.168.201.20@tcp:256:mount.lustre.0 Request processed in 11162us (12166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792120.803147:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 139 00000100:00100000:1.0:1788792120.809251:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792120.809598:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760561280 00000100:00100000:3.0:1788792120.809610:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760561280 00000100:00100000:3.0:1788792120.809813:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 140 00000100:00100000:3.0:1788792120.809827:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+12:18216:x1875683760561280:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788792120.809851:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792120.809895:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c61413aba00/0x4d37c11031f36752 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67618 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792120.809998:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c61413aba00/0x4d37c11031f36752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67618 expref: 13 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792120.810012:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c61413aba00/0x4d37c11031f36752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67618 expref: 13 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792120.810023:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c61413aba00, rc 0) 00000100:00100000:3.0:1788792120.810090:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+13:18216:x1875683760561280:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 269us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792120.810097:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 140 00000100:00100000:2.0:1788792120.814168:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792120.814458:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760561408 00000100:00100000:0.0:1788792120.814480:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760561408 00000100:00100000:0.0:1788792120.814572:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 141 00000100:00100000:0.0:1788792120.814584:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+13:18216:x1875683760561408:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788792120.814831:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+13:18216:x1875683760561408:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 248us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792120.814839:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 141 00000100:00100000:1.0:1788792120.817514:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792120.817602:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760561536 00000100:00100000:0.0:1788792120.817612:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760561536 00000100:00100000:0.0:1788792120.817804:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 142 00000100:00100000:0.0:1788792120.817816:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+13:18216:x1875683760561536:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788792120.818087:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+13:18216:x1875683760561536:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 272us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792120.818096:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 142 00000100:00100000:1.0:1788792120.822494:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792120.822596:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760561664 00000100:00100000:0.0:1788792120.822610:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760561664 00000100:00100000:0.0:1788792120.822677:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 143 00000100:00100000:0.0:1788792120.822689:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+13:18230:x1875683760561664:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788792120.822903:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+13:18230:x1875683760561664:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 216us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792120.822912:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 143 00000100:00100000:2.0:1788792120.839534:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792120.839779:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760561792 00000100:00100000:0.0:1788792120.839793:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760561792 00000100:00100000:0.0:1788792120.839961:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 144 00000100:00100000:0.0:1788792120.839975:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+13:18230:x1875683760561792:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788792120.840146:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+13:18230:x1875683760561792:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 174us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792120.840154:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 144 00000100:00100000:1.0:1788792120.851972:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792120.852099:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792120.852137:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760561920 00000100:00100000:1.0:1788792120.852152:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760561920 00000100:00100000:1.0:1788792120.852205:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760562176 00000100:00100000:1.0:1788792120.852209:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760562176 00000100:00100000:1.0:1788792120.852234:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:1.0:1788792120.852246:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2418:x1875683760561920:12345-192.168.201.20@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788792120.852295:0:22665:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8998039c-e054-49d5-8067-ce5c17a03855@192.168.201.20@tcp t0 exp 0000000000000000 cur 763 last 0 00000020:00000080:1.0:1788792120.852385:0:22665:0:(genops.c:1385:class_connect()) connect: client 8998039c-e054-49d5-8067-ce5c17a03855, cookie 0x4d37c11031f36759 00000004:00100000:1.0:1788792120.852427:0:22665:0:(mdt_handler.c:7331:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788792120.852594:0:22665:0:(import.c:65:import_set_state_nolock()) ffff8c6043369000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788792120.853009:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8998039c-e054-49d5-8067-ce5c17a03855+6:2418:x1875683760561920:12345-192.168.201.20@tcp:38:mount.lustre.0 Request processed in 762us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792120.853019:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:1.0:1788792120.853048:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:1.0:1788792120.853054:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2418:x1875683760562176:12345-192.168.201.20@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788792120.853075:0:22665:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 8998039c-e054-49d5-8067-ce5c17a03855@192.168.201.20@tcp t0 exp 0000000000000000 cur 763 last 0 00000020:00000080:1.0:1788792120.853103:0:22665:0:(genops.c:1385:class_connect()) connect: client 8998039c-e054-49d5-8067-ce5c17a03855, cookie 0x4d37c11031f36760 00000004:00100000:1.0:1788792120.853120:0:22665:0:(mdt_handler.c:7331:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788792120.853177:0:22665:0:(import.c:65:import_set_state_nolock()) ffff8c6043368800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788792120.853204:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8998039c-e054-49d5-8067-ce5c17a03855+6:2418:x1875683760562176:12345-192.168.201.20@tcp:38:mount.lustre.0 Request processed in 149us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792120.853211:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:2.0:1788792120.854690:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60427d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785844736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788792120.854762:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792120.854830:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788792120.854836:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60427d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785844608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788792120.854859:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792120.854935:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785844736 00000100:00100000:2.0:1788792120.854945:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785844736 00000100:00100000:2.0:1788792120.854995:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785844608 00000100:00100000:2.0:1788792120.854998:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785844608 00000100:00100000:2.0:1788792120.855014:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788792120.855023:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785844736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788792120.855046:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788792120.855092:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785844736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792120.855115:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788792120.855132:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788792120.855139:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785844608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788792120.855149:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788792120.855174:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785844608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792120.855181:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788792120.855242:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60427d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785844608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788792120.855256:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60427d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785844736:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788792120.858022:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788792120.870385:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792120.870438:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792120.870504:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792120.870683:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760562432 00000100:00100000:3.0:1788792120.870700:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760562432 00000100:00100000:3.0:1788792120.870813:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760562304 00000100:00100000:3.0:1788792120.870817:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760562304 00000100:00100000:3.0:1788792120.870834:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760562048 00000100:00100000:3.0:1788792120.870836:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760562048 00000100:00100000:3.0:1788792120.870854:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:3.0:1788792120.870867:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8998039c-e054-49d5-8067-ce5c17a03855+7:18216:x1875683760562432:12345-192.168.201.20@tcp:41:mount.lustre.0 00000100:00080000:1.0:1788792120.871098:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788792120.871104:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788792120.871169:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788792120.871352:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:2.0:1788792120.871364:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8998039c-e054-49d5-8067-ce5c17a03855+6:0:x1875683760562304:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788792120.871381:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788792120.871437:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8998039c-e054-49d5-8067-ce5c17a03855+7:18216:x1875683760562432:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 571us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792120.871464:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:3.0:1788792120.871497:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:3.0:1788792120.871504:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c604370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8998039c-e054-49d5-8067-ce5c17a03855+6:0:x1875683760562048:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788792120.871515:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788792120.875257:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8998039c-e054-49d5-8067-ce5c17a03855+6:0:x1875683760562304:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 3876us (4797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792120.875275:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:3.0:1788792120.878096:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c604370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8998039c-e054-49d5-8067-ce5c17a03855+6:0:x1875683760562048:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 6573us (7572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792120.878113:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:1.0:1788792120.883371:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792120.883475:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760562560 00000100:00100000:0.0:1788792120.883488:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760562560 00000100:00100000:0.0:1788792120.883564:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:0.0:1788792120.883576:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8998039c-e054-49d5-8067-ce5c17a03855+6:18216:x1875683760562560:12345-192.168.201.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788792120.883692:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8998039c-e054-49d5-8067-ce5c17a03855+6:18216:x1875683760562560:12345-192.168.201.20@tcp:40:mount.lustre.0 Request processed in 117us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792120.883699:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:1.0:1788792120.888598:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792120.888661:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792120.888708:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792120.888926:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760562688 00000100:00100000:2.0:1788792120.888940:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760562688 00000100:00100000:2.0:1788792120.888988:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760562816 00000100:00100000:2.0:1788792120.888991:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760562816 00000100:00100000:2.0:1788792120.889009:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:2.0:1788792120.889018:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2418:x1875683760562688:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788792120.889064:0:24170:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8998039c-e054-49d5-8067-ce5c17a03855@192.168.201.20@tcp t0 exp 0000000000000000 cur 763 last 0 00000020:00000080:2.0:1788792120.889102:0:24170:0:(genops.c:1385:class_connect()) connect: client 8998039c-e054-49d5-8067-ce5c17a03855, cookie 0x4d37c11031f36767 00002000:00100000:2.0:1788792120.889114:0:24170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8998039c-e054-49d5-8067-ce5c17a03855/ffff8c617dcbc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788792120.889142:0:24170:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788792120.889250:0:24170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788792120.889290:0:24170:0:(import.c:65:import_set_state_nolock()) ffff8c617dcbb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788792120.889371:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8998039c-e054-49d5-8067-ce5c17a03855+6:2418:x1875683760562688:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 352us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792120.889379:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:2.0:1788792120.889397:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1788792120.889401:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2418:x1875683760562816:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788792120.889418:0:24170:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8998039c-e054-49d5-8067-ce5c17a03855@192.168.201.20@tcp t0 exp 0000000000000000 cur 763 last 0 00000020:00000080:2.0:1788792120.889434:0:24170:0:(genops.c:1385:class_connect()) connect: client 8998039c-e054-49d5-8067-ce5c17a03855, cookie 0x4d37c11031f3676e 00002000:00100000:2.0:1788792120.889439:0:24170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8998039c-e054-49d5-8067-ce5c17a03855/ffff8c617dcbf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788792120.889446:0:24170:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788792120.889494:0:24170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788792120.889510:0:24170:0:(import.c:65:import_set_state_nolock()) ffff8c617dcbe800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788792120.889534:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8998039c-e054-49d5-8067-ce5c17a03855+6:2418:x1875683760562816:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 131us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792120.889542:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:3.0:1788792120.890670:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760562944 00000100:00100000:3.0:1788792120.890680:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760562944 00000100:00100000:3.0:1788792120.890738:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:3.0:1788792120.890748:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8998039c-e054-49d5-8067-ce5c17a03855+6:18216:x1875683760562944:12345-192.168.201.20@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788792120.890961:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8998039c-e054-49d5-8067-ce5c17a03855+6:18216:x1875683760562944:12345-192.168.201.20@tcp:900:mount.lustre.0 Request processed in 213us (2378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792120.890969:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:1.0:1788792120.895243:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792120.895430:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760563072 00000100:00100000:2.0:1788792120.895443:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760563072 00000100:00100000:2.0:1788792120.895511:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:2.0:1788792120.895523:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8998039c-e054-49d5-8067-ce5c17a03855+6:18216:x1875683760563072:12345-192.168.201.20@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788792120.895626:0:22668:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788792120.895730:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8998039c-e054-49d5-8067-ce5c17a03855+6:18216:x1875683760563072:12345-192.168.201.20@tcp:33:mount.lustre.0 Request processed in 209us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792120.895750:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:0.0:1788792121.106698:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792121.106854:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760563200 00000100:00100000:2.0:1788792121.106868:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760563200 00000100:00100000:2.0:1788792121.106986:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1788792121.106999:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8998039c-e054-49d5-8067-ce5c17a03855+6:18253:x1875683760563200:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788792121.107026:0:24649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792121.107056:0:24649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f36775 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67649 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792121.107138:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3677c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792121.107154:0:24649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3677c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792121.107170:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3677c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788792121.107232:0:24649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788792121.107236:0:24649:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788792121.107258:0:24649:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3677c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792121.107284:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f36775 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67649 expref: 8 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792121.107304:0:24649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3677c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67649 expref: 7 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792121.107334:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6042484400) 00010000:00010000:2.0:1788792121.107338:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788792121.107343:0:24649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140031800, rc 0) 00000100:00100000:2.0:1788792121.107416:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8998039c-e054-49d5-8067-ce5c17a03855+7:18253:x1875683760563200:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 419us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792121.107424:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:3.0:1788792121.366926:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60427d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785844864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788792121.367054:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792121.367135:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788792121.367143:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785844992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788792121.367180:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792121.367225:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785844864 00000100:00100000:3.0:1788792121.367234:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785844864 00000100:00100000:3.0:1788792121.367299:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785844992 00000100:00100000:3.0:1788792121.367303:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785844992 00000100:00100000:3.0:1788792121.367324:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788792121.367334:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785844864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788792121.367392:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788792121.367450:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785844864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792121.367469:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788792121.367487:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788792121.367493:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785844992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788792121.367502:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788792121.367523:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785844992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792121.367529:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788792121.367545:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788792121.367579:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788792121.367607:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785844992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788792121.367635:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60427d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785844864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788792121.368111:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785845376:0@lo:400:kworker.0 00000100:00100000:1.0:1788792121.368155:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792121.368175:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875683785845888:0@lo:400:kworker.0 00000100:00100000:1.0:1788792121.368200:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792121.368219:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875683785846400:0@lo:400:kworker.0 00000100:00100000:1.0:1788792121.368241:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792121.368261:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788792121.368266:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875683785845504:0@lo:400:kworker.0 00000100:00100000:1.0:1788792121.368288:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792121.368302:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875683785846016:0@lo:400:kworker.0 00000100:00100000:1.0:1788792121.368318:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792121.368344:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785845888 00000100:00100000:1.0:1788792121.368350:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785845888 00000100:00100000:1.0:1788792121.368387:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785846400 00000100:00100000:1.0:1788792121.368389:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785846400 00000100:00100000:1.0:1788792121.368411:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785845504 00000100:00100000:1.0:1788792121.368413:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785845504 00000100:00100000:1.0:1788792121.368422:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785846016 00000100:00100000:1.0:1788792121.368424:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785846016 00000100:00100000:1.0:1788792121.368438:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788792121.368445:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875683785845888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792121.368503:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875683785845888:12345-0@lo:400:kworker.0 Request processed in 57us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792121.368511:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788792121.368526:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788792121.368532:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875683785846400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792121.368560:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875683785846400:12345-0@lo:400:kworker.0 Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792121.368577:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788792121.368590:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788792121.368595:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875683785845504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792121.368635:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875683785845504:12345-0@lo:400:kworker.0 Request processed in 41us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792121.368641:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788792121.368654:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788792121.368659:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875683785846016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792121.368685:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875683785846016:12345-0@lo:400:kworker.0 Request processed in 26us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792121.368690:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1788792121.368707:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788792121.368711:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788792121.368737:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875683785845504:0@lo:400:kworker.0 00000100:00100000:1.0:1788792121.368749:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875683785846016:0@lo:400:kworker.0 00000100:00100000:1.0:1788792121.368758:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875683785845888:0@lo:400:kworker.0 00010000:00080000:1.0:1788792121.368770:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c617b8e9180 x1875683785846400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792121.368782:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875683785846400:0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.369138:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785845120:0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.369184:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792121.369232:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785845632:0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.369265:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792121.369288:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875683785846144:0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.369317:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792121.369340:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788792121.369347:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785845248:0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.369371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792121.369391:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785845760:0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.369415:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792121.369431:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875683785846272:0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.369467:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792121.369498:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785845632 00000100:00100000:2.0:1788792121.369504:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785845632 00000100:00100000:2.0:1788792121.369536:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785845248 00000100:00100000:2.0:1788792121.369539:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785845248 00000100:00100000:2.0:1788792121.369553:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788792121.369572:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785845632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.369633:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785845632:12345-0@lo:400:kworker.0 Request processed in 50us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792121.369641:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788792121.369655:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788792121.369661:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785845248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.369690:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785845248:12345-0@lo:400:kworker.0 Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792121.369696:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788792121.369742:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785845248:0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.369752:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785845632:0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.369781:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785846144 00000100:00100000:2.0:1788792121.369786:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785846144 00000100:00100000:2.0:1788792121.369813:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785846272 00000100:00100000:2.0:1788792121.369816:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785846272 00000100:00100000:2.0:1788792121.369832:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788792121.369838:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875683785846144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.369924:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875683785846144:12345-0@lo:400:kworker.0 Request processed in 35us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792121.369931:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788792121.369944:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788792121.369951:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875683785846272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.370003:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875683785846272:12345-0@lo:400:kworker.0 Request processed in 53us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792121.370010:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788792121.370043:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875683785846272:0@lo:400:kworker.0 00010000:00080000:2.0:1788792121.370056:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c617b8eaa00 x1875683785846144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788792121.370067:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875683785846144:0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.370091:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785845376 00000100:00100000:2.0:1788792121.370095:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785845376 00000100:00100000:2.0:1788792121.370117:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785845760 00000100:00100000:2.0:1788792121.370120:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785845760 00000100:00100000:2.0:1788792121.370136:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788792121.370142:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785845376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.370177:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785845376:12345-0@lo:400:kworker.0 Request processed in 35us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792121.370183:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788792121.370194:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788792121.370200:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785845760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792121.370231:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785845760:12345-0@lo:400:kworker.0 Request processed in 32us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792121.370237:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788792121.370261:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785845760:0@lo:400:kworker.0 00010000:00010000:0.0:1788792121.370862:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788792121.372327:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788792121.372336:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788792121.372400:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785845376:0@lo:400:kworker.0 00000100:00100000:1.0:1788792121.372454:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785845120 00000100:00100000:1.0:1788792121.372490:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785845120 00000100:00100000:1.0:1788792121.372551:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788792121.372559:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:3641:x1875683785845120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792121.372663:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:3641:x1875683785845120:12345-0@lo:400:kworker.0 Request processed in 104us (3479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792121.372670:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788792121.373394:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785845120:0@lo:400:kworker.0 00000100:00100000:1.0:1788792121.878976:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785846528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788792121.879067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792121.879491:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785846528 00000100:00100000:3.0:1788792121.879502:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785846528 00000100:00100000:3.0:1788792121.879565:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788792121.879578:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785846528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788792121.879812:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788792121.880020:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875683785846528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 443us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792121.880030:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788792121.880443:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875683785846528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788792121.880705:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785846656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788792121.880753:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792121.880849:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785846656 00000100:00100000:1.0:1788792121.880855:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785846656 00000100:00100000:1.0:1788792121.881061:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788792121.881072:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785846656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788792121.881103:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788792121.881207:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785846656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792121.881216:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788792121.887466:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785846656:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788792122.007282:0:23423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788792122.395459:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788792122.912197:0:23397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8998039c-e054-49d5-8067-ce5c17a03855 00000001:00100000:1.0:1788792122.912213:0:23397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f7fc150c-125b-4591-9e6f-98bd2b6bdc11 00000001:00100000:0.0:1788792122.917524:0:22644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8998039c-e054-49d5-8067-ce5c17a03855 00000001:00100000:0.0:1788792122.917542:0:22644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f7fc150c-125b-4591-9e6f-98bd2b6bdc11 00010000:00010000:0.0:1788792123.414142:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788792123.928865:0:24987:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8998039c-e054-49d5-8067-ce5c17a03855 00000001:00100000:0.0:1788792123.928923:0:24987:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7fc150c-125b-4591-9e6f-98bd2b6bdc11 00000001:00100000:3.0:1788792123.930921:0:24166:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8998039c-e054-49d5-8067-ce5c17a03855 00000001:00100000:3.0:1788792123.930952:0:24166:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f7fc150c-125b-4591-9e6f-98bd2b6bdc11 00010000:00010000:1.0:1788792124.439079:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788792124.618055:0:25546:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788792125.462215:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788792125.977322:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788792125.977351:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61412afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785846784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788792125.977441:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792125.977516:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785846784 00000100:00100000:1.0:1788792125.977525:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785846784 00000100:00100000:1.0:1788792125.977592:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788792125.977604:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785846784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788792125.977634:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788792125.977681:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785846784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792125.977688:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788792125.977708:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788792125.977745:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61412afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785846784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788792125.984342:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785846912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788792125.984457:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792125.984570:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785846912 00000100:00100000:1.0:1788792125.984582:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785846912 00000100:00100000:1.0:1788792125.984653:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788792125.984666:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785846912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788792125.984692:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788792125.991116:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788792125.991504:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785846912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6832us (7038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792125.991518:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788792125.997905:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785846912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788792126.239404:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792126.240097:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760563328 00000100:00100000:0.0:1788792126.240109:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760563328 00000100:00100000:0.0:1788792126.240172:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 146 00000100:00100000:0.0:1788792126.240183:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+13:2421:x1875683760563328:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788792126.240264:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+13:2421:x1875683760563328:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 83us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792126.240300:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 146 00000100:00100000:1.0:1788792126.241449:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792126.241488:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792126.241515:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792126.241546:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792126.241574:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792126.241596:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792126.241619:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792126.241641:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792126.241669:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760563840 00000100:00100000:1.0:1788792126.241675:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760563840 00000100:00100000:1.0:1788792126.241731:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760564352 00000100:00100000:1.0:1788792126.241734:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760564352 00000100:00100000:1.0:1788792126.241748:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760563712 00000100:00100000:1.0:1788792126.241751:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760563712 00000100:00100000:1.0:1788792126.241765:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760564224 00000100:00100000:1.0:1788792126.241768:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760564224 00000100:00100000:1.0:1788792126.241785:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:1.0:1788792126.241794:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2421:x1875683760563840:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788792126.241865:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2421:x1875683760563840:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 71us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792126.241893:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:1.0:1788792126.241911:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:1.0:1788792126.241919:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8998039c-e054-49d5-8067-ce5c17a03855+5:2421:x1875683760564352:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788792126.241946:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8998039c-e054-49d5-8067-ce5c17a03855+5:2421:x1875683760564352:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792126.241953:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:1.0:1788792126.241977:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:1.0:1788792126.241984:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2421:x1875683760563712:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788792126.242481:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2421:x1875683760563712:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 493us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792126.242489:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:1.0:1788792126.242509:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:1.0:1788792126.242516:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8998039c-e054-49d5-8067-ce5c17a03855+5:2421:x1875683760564224:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788792126.242559:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8998039c-e054-49d5-8067-ce5c17a03855+5:2421:x1875683760564224:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 44us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792126.242579:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:1.0:1788792126.242609:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760563584 00000100:00100000:1.0:1788792126.242616:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760563584 00000100:00100000:1.0:1788792126.242644:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760564096 00000100:00100000:1.0:1788792126.242647:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760564096 00000100:00100000:1.0:1788792126.242659:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760563456 00000100:00100000:1.0:1788792126.242662:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760563456 00000100:00100000:1.0:1788792126.242673:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760563968 00000100:00100000:1.0:1788792126.242675:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760563968 00000100:00100000:1.0:1788792126.242691:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:1.0:1788792126.242697:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2421:x1875683760563584:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788792126.242729:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2421:x1875683760563584:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 31us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792126.242736:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:1.0:1788792126.242749:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:1.0:1788792126.242755:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8998039c-e054-49d5-8067-ce5c17a03855+5:2421:x1875683760564096:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788792126.242796:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8998039c-e054-49d5-8067-ce5c17a03855+5:2421:x1875683760564096:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 41us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792126.242803:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:1.0:1788792126.242815:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:1.0:1788792126.242821:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:2421:x1875683760563456:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788792126.243269:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:2421:x1875683760563456:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 445us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792126.243276:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:1.0:1788792126.243291:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:1.0:1788792126.243306:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8998039c-e054-49d5-8067-ce5c17a03855+6:2421:x1875683760563968:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788792126.243331:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8998039c-e054-49d5-8067-ce5c17a03855+6:2421:x1875683760563968:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792126.243338:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00080000:0.0:1788792126.243913:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788792126.243919:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788792126.243922:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788792126.243925:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788792126.486267:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788792126.487099:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788792126.487131:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785847040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788792126.487240:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792126.487341:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785847040 00000100:00100000:3.0:1788792126.487354:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785847040 00000100:00100000:3.0:1788792126.487984:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788792126.488211:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785847168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788792126.488256:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792126.488418:0:24173:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788792126.488675:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785847040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788792126.488715:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788792126.488771:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785847040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 777us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792126.488779:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788792126.488801:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785847168 00000100:00100000:3.0:1788792126.488807:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785847168 00000100:00100000:3.0:1788792126.488842:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788792126.488848:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785847168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788792126.488858:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788792126.488902:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785847168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792126.488908:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788792126.488927:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788792126.489509:0:24173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788792126.489717:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785847552:0@lo:400:kworker.0 00000100:00100000:0.0:1788792126.489766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792126.492548:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785847424:0@lo:400:kworker.0 00000100:00100000:3.0:1788792126.492628:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792126.492686:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785847936:0@lo:400:kworker.0 00000100:00100000:3.0:1788792126.492730:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785847424 00000100:00100000:3.0:1788792126.492739:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785847424 00000100:00100000:0.0:1788792126.497088:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875683785848064:0@lo:400:kworker.0 00000100:00100000:0.0:1788792126.497184:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792126.497227:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875683785848576:0@lo:400:kworker.0 00000100:00100000:0.0:1788792126.497251:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792126.498033:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785847552 00000100:00100000:0.0:1788792126.498047:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785847552 00000100:00100000:0.0:1788792126.498124:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788792126.498135:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785847552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792126.498204:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785847552:12345-0@lo:400:kworker.0 Request processed in 71us (8436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792126.498212:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788792126.498244:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a140336d-9a80-41e1-97b0-93600c05b204:3642:1875683785847296:0@lo:400:kworker.0 00000100:00100000:0.0:1788792126.498539:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792126.498592:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785847808:0@lo:400:kworker.0 00000100:00100000:0.0:1788792126.498623:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792126.498891:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785848064 00000100:00100000:1.0:1788792126.498901:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785848064 00000100:00100000:1.0:1788792126.499244:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785848576 00000100:00100000:1.0:1788792126.499248:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785848576 00000100:00100000:1.0:1788792126.499309:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788792126.499321:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875683785848064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792126.499411:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875683785848064:12345-0@lo:400:kworker.0 Request processed in 93us (2226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792126.499419:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788792126.499455:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788792126.499462:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875683785848576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792126.499493:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875683785848576:12345-0@lo:400:kworker.0 Request processed in 32us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792126.499498:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788792126.500223:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785847680:0@lo:400:kworker.0 00000100:00100000:1.0:1788792126.500290:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792126.500320:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875683785848192:0@lo:400:kworker.0 00000100:00100000:1.0:1788792126.500352:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792126.500429:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785847168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788792126.500470:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785847680 00000100:00100000:1.0:1788792126.500475:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785847680 00000100:00100000:1.0:1788792126.500503:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785848192 00000100:00100000:1.0:1788792126.500505:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785848192 00000100:00100000:1.0:1788792126.500522:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788792126.500541:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785847680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792126.500586:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785847680:12345-0@lo:400:kworker.0 Request processed in 47us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792126.500594:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788792126.500609:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788792126.500615:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875683785848192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792126.500643:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875683785848192:12345-0@lo:400:kworker.0 Request processed in 27us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792126.500649:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788792126.500680:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785847680:0@lo:400:kworker.0 00000100:00100000:1.0:1788792126.500691:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875683785848192:0@lo:400:kworker.0 00000100:00100000:1.0:1788792126.500733:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875683785848064:0@lo:400:kworker.0 00010000:00080000:1.0:1788792126.500754:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c61435cce00 x1875683785848576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788792126.500767:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875683785848576:0@lo:400:kworker.0 00000100:00100000:1.0:1788792126.500786:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785847552:0@lo:400:kworker.0 00000100:00100000:2.0:1788792126.501607:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785847296 00000100:00100000:2.0:1788792126.501618:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785847296 00000100:00100000:2.0:1788792126.501679:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788792126.501689:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+24:3642:x1875683785847296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792126.501769:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+24:3642:x1875683785847296:12345-0@lo:400:kworker.0 Request processed in 82us (3230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792126.501776:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788792126.502599:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792126.502941:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875683785848448:0@lo:400:kworker.0 00000100:00100000:2.0:1788792126.503250:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792126.503336:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785847040:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788792126.503401:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788792126.503407:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788792126.503967:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875683785848320:0@lo:400:kworker.0 00000100:00100000:0.0:1788792126.504171:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792126.504212:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a140336d-9a80-41e1-97b0-93600c05b204:3642:1875683785847296:0@lo:400:kworker.0 00000100:00100000:0.0:1788792126.504266:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785848448 00000100:00100000:0.0:1788792126.504273:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785848448 00000100:00100000:0.0:1788792126.504336:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785848320 00000100:00100000:0.0:1788792126.504340:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785848320 00000100:00100000:0.0:1788792126.504358:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788792126.504375:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875683785848448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792126.504624:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875683785848448:12345-0@lo:400:kworker.0 Request processed in 258us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792126.504634:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788792126.504653:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788792126.504659:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875683785848320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792126.504695:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875683785848320:12345-0@lo:400:kworker.0 Request processed in 36us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792126.504702:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788792126.504932:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788792126.504937:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788792126.505169:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875683785848448:0@lo:400:kworker.0 00010000:00080000:0.0:1788792126.505215:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c61435cc380 x1875683785848320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788792126.505226:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875683785848320:0@lo:400:kworker.0 00000100:00100000:3.0:1788792126.506491:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785847808 00000100:00100000:3.0:1788792126.506507:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785847808 00000100:00100000:0.0:1788792126.506795:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785847936 00000100:00100000:0.0:1788792126.506801:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785847936 00000100:00100000:0.0:1788792126.506868:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788792126.506894:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785847936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792126.507022:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785847936:12345-0@lo:400:kworker.0 Request processed in 129us (4425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792126.507045:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788792126.507103:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785847936:0@lo:400:kworker.0 00000100:00100000:3.0:1788792126.510076:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788792126.510100:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785847424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792126.510237:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785847424:12345-0@lo:400:kworker.0 Request processed in 145us (17607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792126.510245:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788792126.510269:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788792126.510289:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785847808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792126.510329:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785847808:12345-0@lo:400:kworker.0 Request processed in 53us (11704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792126.510335:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788792126.510402:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785847424:0@lo:400:kworker.0 00000100:00100000:3.0:1788792126.510790:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785847808:0@lo:400:kworker.0 00000100:00100000:0.0:1788792127.000184:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785848704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788792127.000265:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792127.000714:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785848832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788792127.000748:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792127.000802:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785848704 00000100:00100000:3.0:1788792127.000811:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785848704 00000100:00100000:3.0:1788792127.000859:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785848832 00000100:00100000:3.0:1788792127.000862:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785848832 00000100:00100000:3.0:1788792127.000901:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788792127.000913:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785848704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788792127.000955:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788792127.002722:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785848704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1796us (2442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792127.002740:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788792127.002808:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788792127.002825:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785848832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788792127.002888:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788792127.002966:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785848832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792127.002972:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788792127.003431:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785848704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788792127.004481:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785848832:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788792127.511009:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788792127.896230:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788792128.541842:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788792129.418357:0:25695:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffde50d40 20000000:00000080:3.0:1788792129.418378:0:25695:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c617dc8f000 uarg=0000000000000000 20000000:01000000:3.0:1788792129.418447:0:25695:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788792129.418593:0:25695:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788792129.418601:0:25695:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788792129.419397:0:25696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788792129.419715:0:25695:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788792129.425622:0:25695:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788792129.425665:0:25695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.425689:0:25695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c617b953600/0x4d37c11031f363e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f363d9 expref: 23 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.425697:0:25695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c6181362200/0x4d37c11031f363ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f363e7 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.425704:0:25695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c6140030e00/0x4d37c11031f3642d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36426 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.425731:0:25695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c615086cc00/0x4d37c11031f365ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f365a7 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.425742:0:25695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c6140030000/0x4d37c11031f36713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675a8 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.425750:0:25695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c61413aba00/0x4d37c11031f36752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67618 expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.425758:0:25695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.426020:0:25695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c61413aba00/0x4d37c11031f36752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67618 expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.426035:0:25695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c61413aba00/0x4d37c11031f36752 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67618 expref: 12 pid: 22658 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792129.426052:0:25695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617f9b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875683785848960:192.168.201.20@tcp:104: 00010000:00010000:2.0:1788792129.426164:0:25695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c6140030000/0x4d37c11031f36713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675a8 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.426173:0:25695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c6140030000/0x4d37c11031f36713 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675a8 expref: 12 pid: 22657 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792129.426183:0:25695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617f9b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875683785849088:192.168.201.20@tcp:104: 00010000:00010000:2.0:1788792129.426215:0:25695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c615086cc00/0x4d37c11031f365ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4d37c11031f365a7 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.426234:0:25695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c615086cc00/0x4d37c11031f365ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4d37c11031f365a7 expref: 23 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792129.426245:0:25695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617f9b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875683785849216:0@lo:104: 00000100:00100000:2.0:1788792129.426292:0:25695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788792129.426684:0:25695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c6140030e00/0x4d37c11031f3642d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4d37c11031f36426 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.426693:0:25695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c6140030e00/0x4d37c11031f3642d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4d37c11031f36426 expref: 23 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792129.426703:0:25695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617f9b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875683785849344:0@lo:104: 00000100:00100000:2.0:1788792129.426726:0:25695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792129.430938:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792129.430982:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792129.431012:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760564608 00000100:00100000:1.0:1788792129.431022:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760564608 00010000:00010000:1.0:1788792129.431068:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c6140030000/0x4d37c11031f36713 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675a8 expref: 13 pid: 22657 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792129.431106:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760564480 00000100:00100000:1.0:1788792129.431109:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760564480 00010000:00010000:1.0:1788792129.431122:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c61413aba00/0x4d37c11031f36752 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67618 expref: 14 pid: 22658 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792129.431146:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:1.0:1788792129.431158:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55156022-243d-49cf-9038-3cfcecfd35e3+14:2420:x1875683760564608:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788792129.431174:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788792129.431182:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c6140030000/0x4d37c11031f36713 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675a8 expref: 14 pid: 22657 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792129.431194:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c6140030000/0x4d37c11031f36713 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675a8 expref: 14 pid: 22657 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792129.431219:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788792129.431276:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55156022-243d-49cf-9038-3cfcecfd35e3+14:2420:x1875683760564608:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 120us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792129.431284:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:1.0:1788792129.431303:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:1.0:1788792129.431309:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55156022-243d-49cf-9038-3cfcecfd35e3+13:2420:x1875683760564480:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788792129.431343:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788792129.431349:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c61413aba00/0x4d37c11031f36752 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67618 expref: 13 pid: 22658 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792129.431358:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c61413aba00/0x4d37c11031f36752 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67618 expref: 13 pid: 22658 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792129.431368:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788792129.431388:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55156022-243d-49cf-9038-3cfcecfd35e3+13:2420:x1875683760564480:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 80us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792129.431394:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00010000:00010000:2.0:1788792129.433862:0:25695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c6181362200/0x4d37c11031f363ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4d37c11031f363e7 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.433898:0:25695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c6181362200/0x4d37c11031f363ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4d37c11031f363e7 expref: 23 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792129.433916:0:25695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617f9b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875683785849472:0@lo:104: 00000100:00100000:2.0:1788792129.433980:0:25695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792129.434367:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785849216 00000100:00100000:3.0:1788792129.434378:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785849216 00000100:00100000:3.0:1788792129.434444:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785849344 00000100:00100000:3.0:1788792129.434448:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785849344 00000100:00100000:3.0:1788792129.434475:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788792129.434494:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a140336d-9a80-41e1-97b0-93600c05b204+4:25695:x1875683785849216:12345-0@lo:104: 00010000:00010000:3.0:1788792129.434511:0:22647:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f365ae expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.434574:0:22647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788792129.434582:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a140336d-9a80-41e1-97b0-93600c05b204+4:25695:x1875683785849216:12345-0@lo:104: Request processed in 89us (8289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792129.434588:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788792129.434608:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788792129.434615:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a140336d-9a80-41e1-97b0-93600c05b204+3:25695:x1875683785849344:12345-0@lo:104: 00010000:00010000:3.0:1788792129.434639:0:22647:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f3642d expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.434677:0:22647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788792129.434682:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a140336d-9a80-41e1-97b0-93600c05b204+3:25695:x1875683785849344:12345-0@lo:104: Request processed in 68us (7956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792129.434688:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788792129.434712:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788792129.434720:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f365ae expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.434727:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e67400 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:3.0:1788792129.434733:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4d37c11031f365ae expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.434741:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4d37c11031f365ae expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788792129.434749:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4d37c11031f365ae expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788792129.434754:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788792129.435070:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f365ae expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.435079:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788792129.435101:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f365ae expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.435120:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c6174e67400/0x4d37c11031f365a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f365ae expref: -99 pid: 24986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.435303:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792129.435306:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f3642d expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.435312:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c617b953c00 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:3.0:1788792129.435324:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4d37c11031f3642d expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.435332:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4d37c11031f3642d expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788792129.435339:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4d37c11031f3642d expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788792129.435344:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788792129.435359:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3642d expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.435366:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788792129.435373:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3642d expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.435379:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c617b953c00/0x4d37c11031f36426 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f3642d expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.435387:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792129.435388:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792129.435390:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788792129.435417:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785849600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788792129.435618:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792129.435659:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788792129.435666:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785849728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788792129.435687:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792129.435717:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785849600 00000100:00100000:3.0:1788792129.435723:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785849600 00010000:00010000:3.0:1788792129.435750:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c615086cc00/0x4d37c11031f365ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f365a7 expref: 24 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792129.435847:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785849728 00000100:00100000:3.0:1788792129.435852:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785849728 00010000:00010000:3.0:1788792129.435865:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c6140030e00/0x4d37c11031f3642d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f36426 expref: 25 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792129.435905:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788792129.435913:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a140336d-9a80-41e1-97b0-93600c05b204+25:3643:x1875683785849600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788792129.435926:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788792129.435932:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c615086cc00/0x4d37c11031f365ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f365a7 expref: 25 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.435943:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c615086cc00/0x4d37c11031f365ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4d37c11031f365a7 expref: 25 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.435961:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788792129.435993:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a140336d-9a80-41e1-97b0-93600c05b204+25:3643:x1875683785849600:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792129.436000:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788792129.436014:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788792129.436019:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a140336d-9a80-41e1-97b0-93600c05b204+24:3643:x1875683785849728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788792129.436033:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788792129.436037:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c6140030e00/0x4d37c11031f3642d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f36426 expref: 24 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.436045:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c6140030e00/0x4d37c11031f3642d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4d37c11031f36426 expref: 24 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.436054:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788792129.436073:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a140336d-9a80-41e1-97b0-93600c05b204+24:3643:x1875683785849728:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792129.436078:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788792129.436332:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788792129.436556:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785849728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788792129.436569:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a140336d-9a80-41e1-97b0-93600c05b204:3643:1875683785849600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788792129.436754:0:25695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c617b953600/0x4d37c11031f363e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4d37c11031f363d9 expref: 23 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.436777:0:25695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c617b953600/0x4d37c11031f363e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4d37c11031f363d9 expref: 23 pid: 22658 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792129.436789:0:25695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617f9b2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875683785849856:0@lo:104: 00000100:00100000:2.0:1788792129.436831:0:25695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792129.437034:0:25695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b39c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788792129.437052:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c61413aba00/0x4d37c11031f36752 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67618 expref: 12 pid: 22658 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792129.437067:0:25695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617f9b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875683785848960:192.168.201.20@tcp:104: 00010000:00010000:2.0:1788792129.437077:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6140030000/0x4d37c11031f36713 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675a8 expref: 11 pid: 22657 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792129.437087:0:25695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617f9b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875683785849088:192.168.201.20@tcp:104: 00010000:00010000:2.0:1788792129.437097:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c615086cc00/0x4d37c11031f365ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4d37c11031f365a7 expref: 23 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792129.437115:0:25695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617f9b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875683785849216:0@lo:104: 00010000:00010000:2.0:1788792129.437136:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6140030e00/0x4d37c11031f3642d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4d37c11031f36426 expref: 22 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792129.437144:0:25695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617f9b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875683785849344:0@lo:104: 00000100:00100000:1.0:1788792129.437681:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785849472 00000100:00100000:1.0:1788792129.437693:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785849472 00000100:00100000:1.0:1788792129.437744:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785849856 00000100:00100000:1.0:1788792129.437747:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785849856 00000100:00100000:1.0:1788792129.437761:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788792129.437844:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+4:25695:x1875683785849472:12345-0@lo:104: 00010000:00010000:1.0:1788792129.437861:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f363ee expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792129.437982:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788792129.437988:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+4:25695:x1875683785849472:12345-0@lo:104: Request processed in 148us (4009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792129.437994:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788792129.438012:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788792129.438018:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+3:25695:x1875683785849856:12345-0@lo:104: 00010000:00010000:1.0:1788792129.438025:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f363e0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792129.438078:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788792129.438083:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a140336d-9a80-41e1-97b0-93600c05b204+3:25695:x1875683785849856:12345-0@lo:104: Request processed in 67us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792129.438089:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788792129.438350:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788792129.438357:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f363ee expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.438365:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689800 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:3.0:1788792129.438369:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4d37c11031f363ee expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.438379:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4d37c11031f363ee expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788792129.438386:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4d37c11031f363ee expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788792129.438393:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788792129.438463:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f363ee expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.438469:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788792129.438498:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f363ee expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.438505:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c6141689800/0x4d37c11031f363e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f363ee expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.438520:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788792129.438523:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4d37c11031f363e0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.438529:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6181362800 already unused, calling callback (ffffffffc1282c20) 10000000:00010000:3.0:1788792129.438532:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4d37c11031f363e0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.438539:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4d37c11031f363e0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788792129.438545:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4d37c11031f363e0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788792129.438549:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788792129.438562:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f363e0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.438567:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788792129.438573:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f363e0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.438590:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8c6181362800/0x4d37c11031f363d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4d37c11031f363e0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.438605:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792129.438607:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788792129.438608:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788792129.438636:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785849984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788792129.438688:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792129.438738:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788792129.438745:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785850112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788792129.439402:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792129.439486:0:25006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785849984 00000100:00100000:3.0:1788792129.439494:0:25006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785849984 00010000:00010000:3.0:1788792129.439530:0:25006:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c6181362200/0x4d37c11031f363ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f363e7 expref: 22 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792129.439556:0:25006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785850112 00000100:00100000:3.0:1788792129.439559:0:25006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785850112 00010000:00010000:3.0:1788792129.439569:0:25006:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c617b953600/0x4d37c11031f363e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f363d9 expref: 23 pid: 22658 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792129.439585:0:25006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788792129.439593:0:25006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6143910450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a140336d-9a80-41e1-97b0-93600c05b204+23:3641:x1875683785849984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788792129.439606:0:25006:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788792129.439611:0:25006:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c6181362200/0x4d37c11031f363ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f363e7 expref: 23 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.439621:0:25006:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c6181362200/0x4d37c11031f363ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4d37c11031f363e7 expref: 23 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.439651:0:25006:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788792129.439692:0:25006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6143910450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a140336d-9a80-41e1-97b0-93600c05b204+23:3641:x1875683785849984:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792129.439699:0:25006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788792129.439751:0:25006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788792129.439758:0:25006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a140336d-9a80-41e1-97b0-93600c05b204+22:3641:x1875683785850112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788792129.439765:0:25006:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788792129.439769:0:25006:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c617b953600/0x4d37c11031f363e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4d37c11031f363d9 expref: 22 pid: 22658 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.439983:0:25006:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c617b953600/0x4d37c11031f363e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4d37c11031f363d9 expref: 22 pid: 22658 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.439997:0:25006:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.440006:0:25006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.440022:0:25006:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.440029:0:25006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.440035:0:25006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.440040:0:25006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.440054:0:25006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140031200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792129.440059:0:25006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.440066:0:25006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.440076:0:25006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792129.440087:0:25006:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788792129.440235:0:25006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a140336d-9a80-41e1-97b0-93600c05b204+22:3641:x1875683785850112:12345-0@lo:103:ldlm_bl.0 Request processed in 477us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792129.440242:0:25006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788792129.440294:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785850112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788792129.440303:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785849984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788792129.440684:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792129.440915:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6181362200/0x4d37c11031f363ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4d37c11031f363e7 expref: 21 pid: 22659 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792129.440930:0:25695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617f9b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875683785849472:0@lo:104: 00010000:00010000:2.0:1788792129.440939:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c617b953600/0x4d37c11031f363e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4d37c11031f363d9 expref: 20 pid: 22658 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792129.440947:0:25695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617f9b2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25695:1875683785849856:0@lo:104: 00010000:00010000:2.0:1788792129.440969:0:25695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.440990:0:25695:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.440997:0:25695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792129.441004:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c6140031200/0x4d37c11031f36783 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792129.560620:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788792130.582238:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788792130.774303:0:22661:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788792130.774316:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c614f2c6000 from 13 10000000:01000000:3.0:1788792130.774323:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788792130.774382:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c61413aaa00/0x4d37c11031f3678a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792130.774394:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c61413aaa00/0x4d37c11031f3678a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792130.774407:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c61413aaa00/0x4d37c11031f3678a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792130.774456:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785850240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788792130.774544:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792130.774607:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c616d3f7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788792130.774727:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785850240 00000100:00100000:0.0:1788792130.774737:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785850240 00000100:00100000:0.0:1788792130.774826:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788792130.774835:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+20:22661:x1875683785850240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788792130.774851:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788792130.774867:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c615086c400/0x4d37c11031f36791 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f3678a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792130.774930:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c615086c400/0x4d37c11031f36791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f3678a expref: 21 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792130.774940:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c615086c400/0x4d37c11031f36791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f3678a expref: 21 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792130.774950:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c615086c400, rc 0) 00000100:00100000:0.0:1788792130.775002:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+21:22661:x1875683785850240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792130.775008:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788792130.775319:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785850240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788792130.775335:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c61413aaa00/0x4d37c11031f3678a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36791 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792130.775345:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c61413aaa00/0x4d37c11031f3678a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f36791 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792130.775417:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785850368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788792130.775446:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792130.775474:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c616d3f7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788792130.775533:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785850368 00000100:00100000:0.0:1788792130.775550:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785850368 00000100:00100000:0.0:1788792130.775592:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788792130.775599:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+21:22661:x1875683785850368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788792130.776238:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+21:22661:x1875683785850368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 635us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792130.776247:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788792130.787986:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785850368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788792130.788074:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785850496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788792130.788196:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792130.788250:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c616d3f7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788792130.788420:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785850496 00000100:00100000:2.0:1788792130.788430:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785850496 00000100:00100000:2.0:1788792130.788491:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788792130.788502:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181b87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:22661:x1875683785850496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788792130.788644:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181b87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+21:22661:x1875683785850496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792130.788653:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788792130.788864:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785850496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788792130.792011:0:25708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788792130.792472:0:22661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788792130.792498:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788792130.792511:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c61413aaa00/0x4d37c11031f3678a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36791 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792130.792524:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c61413aaa00/0x4d37c11031f3678a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f36791 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788792130.792536:0:22661:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788792130.792540:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c614f2f0000 from 13 10000000:01000000:0.0:1788792130.792543:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788792130.792592:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c615086d200/0x4d37c11031f36798 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792130.792602:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c615086d200/0x4d37c11031f36798 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792130.792615:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c615086d200/0x4d37c11031f36798 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792130.792647:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785850624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788792130.792727:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792130.792800:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6159cfe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788792130.792935:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785850624 00000100:00100000:2.0:1788792130.792946:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785850624 00000100:00100000:2.0:1788792130.793015:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788792130.793027:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+21:22661:x1875683785850624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788792130.793042:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792130.793058:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6140031200/0x4d37c11031f3679f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f36798 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.793082:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6140031200/0x4d37c11031f3679f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f36798 expref: 22 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.793094:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6140031200/0x4d37c11031f3679f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f36798 expref: 22 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.793138:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140031200, rc 0) 00000100:00100000:2.0:1788792130.793190:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+22:22661:x1875683785850624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792130.793197:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788792130.794082:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785850624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788792130.794270:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c615086d200/0x4d37c11031f36798 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3679f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792130.794283:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c615086d200/0x4d37c11031f36798 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f3679f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792130.794386:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785850752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788792130.794439:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792130.794479:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c616d3f7240 going to sleep for 11 seconds 00000100:00100000:1.0:1788792130.794542:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785850752 00000100:00100000:1.0:1788792130.794550:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785850752 00000100:00100000:1.0:1788792130.794602:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788792130.794612:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+22:22661:x1875683785850752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788792130.794736:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+22:22661:x1875683785850752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792130.794755:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788792130.794952:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785850752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788792130.794979:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785850880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788792130.795020:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792130.795089:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c616d3f7240 going to sleep for 11 seconds 00000100:00100000:0.0:1788792130.803241:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785850880 00000100:00100000:0.0:1788792130.803272:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785850880 00000100:00100000:0.0:1788792130.803674:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788792130.803686:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+22:22661:x1875683785850880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788792130.803930:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+22:22661:x1875683785850880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (8907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792130.803939:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788792130.804068:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785850880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788792130.805342:0:25709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788792130.805716:0:22661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788792130.805760:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788792130.805775:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c615086d200/0x4d37c11031f36798 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3679f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.805788:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c615086d200/0x4d37c11031f36798 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f3679f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788792130.805800:0:22661:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788792130.805803:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c617f976000 from 13 10000000:01000000:2.0:1788792130.805805:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788792130.805851:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6140030e00/0x4d37c11031f367a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.805860:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c6140030e00/0x4d37c11031f367a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.805903:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c6140030e00/0x4d37c11031f367a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792130.805932:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617f9b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785851008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788792130.806009:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792130.822340:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788792130.825170:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785851008 00000100:00100000:1.0:1788792130.825199:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785851008 00000100:00100000:1.0:1788792130.825278:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788792130.825289:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+22:22661:x1875683785851008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788792130.825321:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788792130.825341:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6141688800/0x4d37c11031f367ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f367a6 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792130.825375:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6141688800/0x4d37c11031f367ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f367a6 expref: 23 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792130.825388:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6141688800/0x4d37c11031f367ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f367a6 expref: 23 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792130.825419:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6141688800, rc 0) 00000100:00100000:1.0:1788792130.825645:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+23:22661:x1875683785851008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 358us (19637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792130.825653:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788792130.825815:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617f9b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785851008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788792130.825843:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c6140030e00/0x4d37c11031f367a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f367ad expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.825852:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c6140030e00/0x4d37c11031f367a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f367ad expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792130.825952:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617f9b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785851136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788792130.825984:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792130.826013:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788792130.827614:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785851136 00000100:00100000:1.0:1788792130.827631:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785851136 00000100:00100000:1.0:1788792130.827683:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788792130.827692:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+23:22661:x1875683785851136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788792130.827898:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+23:22661:x1875683785851136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792130.827974:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617f9b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785851136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788792130.828025:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617f9b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785851264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788792130.828091:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792130.828119:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788792130.828198:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788792130.828224:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785851264 00000100:00100000:1.0:1788792130.828228:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785851264 00000100:00100000:1.0:1788792130.828245:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788792130.828251:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+23:22661:x1875683785851264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788792130.828416:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+23:22661:x1875683785851264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792130.828423:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788792130.836854:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617f9b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785851264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788792130.845471:0:25710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788792130.845831:0:22661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788792130.845857:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788792130.845870:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c6140030e00/0x4d37c11031f367a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f367ad expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792130.845903:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c6140030e00/0x4d37c11031f367a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f367ad expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788792130.845914:0:22661:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788792130.845917:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c617fa8f000 from 13 10000000:01000000:3.0:1788792130.845919:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788792130.845957:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c61413ab000/0x4d37c11031f367b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792130.845965:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8c61413ab000/0x4d37c11031f367b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792130.845989:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8c61413ab000/0x4d37c11031f367b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792130.846015:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785851392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788792130.846088:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792130.846129:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c616d3f7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788792130.846464:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785851392 00000100:00100000:1.0:1788792130.846473:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785851392 00000100:00100000:1.0:1788792130.846537:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788792130.846551:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+23:22661:x1875683785851392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788792130.846569:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788792130.846583:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6141688200/0x4d37c11031f367bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4d37c11031f367b4 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792130.846626:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6141688200/0x4d37c11031f367bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4d37c11031f367b4 expref: 24 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792130.846638:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6141688200/0x4d37c11031f367bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4d37c11031f367b4 expref: 24 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792130.846646:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6141688200, rc 0) 00000100:00100000:1.0:1788792130.846702:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a140336d-9a80-41e1-97b0-93600c05b204+24:22661:x1875683785851392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792130.846709:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788792130.846867:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785851392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788792130.846919:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8c61413ab000/0x4d37c11031f367b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f367bb expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792130.846929:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8c61413ab000/0x4d37c11031f367b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4d37c11031f367bb expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792130.846996:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785851520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788792130.847025:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792130.847048:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c616d3f7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788792130.848920:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785851520 00000100:00100000:1.0:1788792130.848938:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785851520 00000100:00100000:1.0:1788792130.849016:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788792130.849027:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+24:22661:x1875683785851520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788792130.849475:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+24:22661:x1875683785851520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 450us (2448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792130.849483:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788792130.849577:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785851520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788792130.849626:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785851648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788792130.849682:0:22661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792130.849720:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c616d3f7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788792130.849861:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785851648 00000100:00100000:2.0:1788792130.849868:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785851648 00000100:00100000:2.0:1788792130.849922:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788792130.849931:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+24:22661:x1875683785851648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788792130.850027:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+24:22661:x1875683785851648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792130.850034:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788792130.850353:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a140336d-9a80-41e1-97b0-93600c05b204:22661:1875683785851648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788792130.852978:0:25711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788792130.853408:0:22661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788792130.853433:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788792130.853449:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8c61413ab000/0x4d37c11031f367b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f367bb expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.853476:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8c61413ab000/0x4d37c11031f367b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4d37c11031f367bb expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792130.990389:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792130.991242:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760564736 00000100:00100000:2.0:1788792130.991260:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760564736 00000100:00080000:0.0:1788792130.991417:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788792130.991918:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:2.0:1788792130.991939:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:18722:x1875683760564736:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788792130.991965:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792130.991990:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030000/0x4d37c11031f367c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67650 expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992072:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f367c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992089:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f367c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992115:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f367c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992132:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f367d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992139:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f367d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992146:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f367d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992269:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031400/0x4d37c11031f367d7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992277:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031400/0x4d37c11031f367d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992284:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031400/0x4d37c11031f367d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788792130.992325:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788792130.992330:0:22665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788792130.992374:0:22665:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031400/0x4d37c11031f367d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992386:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f367c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992393:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f367c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992401:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f367c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992409:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140030c00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792130.992414:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f367c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992423:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f367c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992438:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6042484400) 00010000:00010000:2.0:1788792130.992448:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792130.992454:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f367c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992460:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f367c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992477:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f367d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992483:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f367d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992489:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f367d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992493:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140030a00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792130.992496:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f367d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992502:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f367d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992508:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8c6170db3100) 00010000:00010000:2.0:1788792130.992510:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792130.992513:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f367d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992518:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f367d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992556:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030000/0x4d37c11031f367c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67650 expref: 8 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992583:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031400/0x4d37c11031f367d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67650 expref: 7 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792130.992591:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c6170db3000) 00010000:00010000:2.0:1788792130.992594:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788792130.992596:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140031400, rc 0) 00000100:00100000:2.0:1788792130.992695:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:18722:x1875683760564736:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 763us (2317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792130.992703:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:1.0:1788792131.007816:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792131.007935:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760564864 00000100:00100000:2.0:1788792131.007949:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760564864 00000100:00100000:2.0:1788792131.008026:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:2.0:1788792131.008038:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:18722:x1875683760564864:12345-192.168.201.20@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788792131.008154:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:18722:x1875683760564864:12345-192.168.201.20@tcp:900:lhsmtool_posix.0 Request processed in 118us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792131.008163:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:0.0:1788792131.013678:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792131.014029:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760565120 00000100:00100000:1.0:1788792131.014041:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760565120 00000100:00100000:1.0:1788792131.014124:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:1.0:1788792131.014136:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:18722:x1875683760565120:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788792131.014165:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788792131.014190:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f367de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67657 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014316:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f367e5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014335:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f367e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014350:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f367e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014367:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f367ec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014376:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f367ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014383:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f367ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014522:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689800/0x4d37c11031f367f3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014530:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689800/0x4d37c11031f367f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014537:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689800/0x4d37c11031f367f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788792131.014548:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788792131.014720:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f367e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014738:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f367e5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014746:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f367e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014752:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141688000 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:1.0:1788792131.014759:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f367e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014768:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f367e5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014781:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c6170db3000) 00010000:00010000:1.0:1788792131.014784:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788792131.014790:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f367e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014796:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f367e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014812:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f367ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014819:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f367ec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014824:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f367ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014828:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689000 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:1.0:1788792131.014837:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f367ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014844:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f367ec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014852:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c6042484200) 00010000:00010000:1.0:1788792131.014855:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788792131.014858:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f367ec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.014864:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f367ec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.016515:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f367de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67657 expref: 10 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.016545:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689800/0x4d37c11031f367f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67657 expref: 9 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.016555:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c6042484700) 00010000:00010000:1.0:1788792131.016559:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788792131.016562:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6141689800, rc 0) 00000100:00100000:1.0:1788792131.016745:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+9:18722:x1875683760565120:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 2610us (3076us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788792131.016754:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:1.0:1788792131.023444:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792131.024183:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760565248 00000100:00100000:0.0:1788792131.024202:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760565248 00000100:00100000:0.0:1788792131.024312:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:0.0:1788792131.024325:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+9:18722:x1875683760565248:12345-192.168.201.20@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788792131.024466:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+9:18722:x1875683760565248:12345-192.168.201.20@tcp:59:lhsmtool_posix.0 Request processed in 143us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792131.024475:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:2.0:1788792131.027832:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792131.028159:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760565376 00000100:00100000:1.0:1788792131.028172:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760565376 00000100:00100000:1.0:1788792131.028347:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:1.0:1788792131.028390:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:18722:x1875683760565376:12345-192.168.201.20@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788792131.028577:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788792131.030144:0:24649:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1701us 00000040:00080000:2.0:1788792131.030839:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788792131.039020:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792131.039145:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760565504 00000100:00100000:2.0:1788792131.039157:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760565504 00000100:00100000:2.0:1788792131.039334:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:2.0:1788792131.039347:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+9:18728:x1875683760565504:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788792131.039375:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792131.039403:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36801 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c6765e expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039523:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36808 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039540:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039553:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039622:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3680f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039631:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3680f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039639:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3680f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039686:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039694:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36808 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039702:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36808 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039708:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140030c00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792131.039712:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36808 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039731:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36808 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039746:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6042484400) 00010000:00010000:2.0:1788792131.039749:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792131.039900:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039908:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039923:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3680f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039928:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3680f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039934:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3680f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039940:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140031c00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792131.039943:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3680f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039948:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3680f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039956:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8c6170db3100) 00010000:00010000:2.0:1788792131.039958:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792131.039961:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3680f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.039976:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3680f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.040008:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36801 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6765e expref: 10 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.040017:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6042484400) 00010000:00010000:2.0:1788792131.040020:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792131.040023:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36801 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6765e expref: 10 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.040032:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140030a00, rc 0) 00000100:00100000:2.0:1788792131.040087:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+9:18728:x1875683760565504:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 742us (1079us total) trans 0 rc 301/301 00000100:00100000:2.0:1788792131.040093:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:2.0:1788792131.048680:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792131.049378:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760565632 00000100:00100000:1.0:1788792131.049395:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760565632 00000100:00100000:1.0:1788792131.049466:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:1.0:1788792131.049480:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+9:18728:x1875683760565632:12345-192.168.201.20@tcp:700:lfs.0 00000100:00100000:1.0:1788792131.049596:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+9:18728:x1875683760565632:12345-192.168.201.20@tcp:700:lfs.0 Request processed in 118us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792131.049605:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:1.0:1788792131.054062:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792131.054163:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760565888 00000100:00100000:2.0:1788792131.054176:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760565888 00000100:00100000:2.0:1788792131.054245:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:2.0:1788792131.054260:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+9:18728:x1875683760565888:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:2.0:1788792131.054353:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788792131.054392:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689600/0x4d37c11031f3673d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c675d9 expref: 9 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.054417:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6042484400) 00010000:00010000:2.0:1788792131.054423:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788792131.054497:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.054512:0:22664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3677c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67649 expref: 5 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.054522:0:22664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.054562:0:22664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3677c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67649 expref: 5 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.054579:0:22664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3677c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67649 expref: 5 pid: 24649 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792131.054595:0:22664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617f9b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22664:1875683785851776:192.168.201.20@tcp:104: 00000100:00100000:2.0:1788792131.054698:0:22664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61710b3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788792131.088282:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792131.088340:0:25006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760566016 00000100:00100000:1.0:1788792131.088350:0:25006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760566016 00010000:00010000:1.0:1788792131.088410:0:25006:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3677c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67649 expref: 6 pid: 24649 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792131.088446:0:25006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:1.0:1788792131.088457:0:25006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8998039c-e054-49d5-8067-ce5c17a03855+6:2420:x1875683760566016:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788792131.088473:0:25006:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788792131.088481:0:25006:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3677c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67649 expref: 6 pid: 24649 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.088496:0:25006:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3677c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67649 expref: 6 pid: 24649 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.088550:0:25006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6042484400) 00010000:00010000:1.0:1788792131.088556:0:25006:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.088567:0:25006:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.088575:0:25006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.088599:0:25006:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788792131.088660:0:25006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8998039c-e054-49d5-8067-ce5c17a03855+6:2420:x1875683760566016:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 205us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792131.088669:0:25006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00080000:1.0:1788792131.088693:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788792131.090079:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3677c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67649 expref: 5 pid: 24649 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792131.090112:0:22664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617f9b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22664:1875683785851776:192.168.201.20@tcp:104: 00010000:00010000:0.0:1788792131.090141:0:22664:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.090151:0:22664:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.090156:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.090196:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c800/0x4d37c11031f3681d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.090209:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c800/0x4d37c11031f3681d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.090220:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c800/0x4d37c11031f3681d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792131.094303:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788792131.094341:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785851904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788792131.094446:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792131.094506:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785851904 00000100:00100000:3.0:1788792131.094516:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785851904 00000100:00100000:3.0:1788792131.094595:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788792131.094609:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785851904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788792131.094646:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788792131.094692:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785851904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792131.094699:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788792131.094723:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788792131.094774:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785851904:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788792131.097283:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36824 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.097395:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36824 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.097412:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36824 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788792131.097434:0:22664:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000707f8457 reply state 00000000c09af0fc transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36824 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.097446:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36824 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.097467:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c6042484200) 00010000:00010000:1.0:1788792131.097470:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788792131.097475:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788792131.097483:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788792131.097493:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.097501:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.097509:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.097515:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140030a00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:1.0:1788792131.097519:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.097528:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.097540:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6042484400) 00010000:00010000:1.0:1788792131.097542:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788792131.097546:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.097552:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36816 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788792131.097572:0:22664:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000707f8457 reply state 00000000c09af0fc transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c800/0x4d37c11031f3681d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.097593:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c800/0x4d37c11031f3681d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.097600:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8c61435aff00) 00010000:00010000:1.0:1788792131.097602:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788792131.097604:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788792131.097732:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+10:18728:x1875683760565888:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 43470us (43678us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788792131.097742:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:3.0:1788792131.099505:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788792131.099530:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785852032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788792131.099606:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792131.099687:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:18722:x1875683760565376:12345-192.168.201.20@tcp:59:lhsmtool_posix.0 Request processed in 71299us (71866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792131.099697:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:1.0:1788792131.099729:0:25584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785852032 00000100:00100000:1.0:1788792131.099739:0:25584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785852032 00000100:00100000:1.0:1788792131.099791:0:25584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788792131.099800:0:25584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785852032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788792131.099820:0:25584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788792131.099866:0:25584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785852032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (258us total) trans 0 rc 0/0 00000100:00080000:3.0:1788792131.099890:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788792131.099893:0:25584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788792131.099938:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785852032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788792131.163989:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792131.164104:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760566144 00000100:00100000:2.0:1788792131.164116:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760566144 00000100:00100000:2.0:1788792131.164188:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:2.0:1788792131.164201:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+10:18736:x1875683760566144:12345-192.168.201.20@tcp:101:lctl.0 00010000:00010000:2.0:1788792131.164230:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792131.164257:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f3682b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67665 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.164367:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36832 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.164382:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.164411:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788792131.164472:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788792131.164476:0:22666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788792131.164513:0:22666:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.164540:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f3682b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67665 expref: 12 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.164562:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030a00/0x4d37c11031f36832 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67665 expref: 11 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.164572:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6170db3100) 00010000:00010000:2.0:1788792131.164575:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788792131.164579:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140030a00, rc 0) 00000100:00100000:2.0:1788792131.164647:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+11:18736:x1875683760566144:12345-192.168.201.20@tcp:101:lctl.0 Request processed in 449us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792131.164654:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:2.0:1788792131.195324:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792131.195436:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760566272 00000100:00100000:1.0:1788792131.195448:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760566272 00000100:00100000:1.0:1788792131.195521:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:1.0:1788792131.195534:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8998039c-e054-49d5-8067-ce5c17a03855+5:18737:x1875683760566272:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788792131.195556:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788792131.195593:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36839 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c6766c expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.195670:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689600/0x4d37c11031f36840 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.195684:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689600/0x4d37c11031f36840 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.195697:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689600/0x4d37c11031f36840 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788792131.195818:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788792131.195822:0:22664:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788792131.196236:0:22664:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689600/0x4d37c11031f36840 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.196272:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36839 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6766c expref: 7 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.196301:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689600/0x4d37c11031f36840 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6766c expref: 6 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.196311:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6170db3100) 00010000:00010000:1.0:1788792131.196314:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788792131.196318:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6141689600, rc 0) 00000100:00100000:1.0:1788792131.196436:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8998039c-e054-49d5-8067-ce5c17a03855+6:18737:x1875683760566272:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 905us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792131.196443:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:1.0:1788792131.204674:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792131.205200:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760566400 00000100:00100000:2.0:1788792131.205213:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760566400 00000100:00100000:2.0:1788792131.205283:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:2.0:1788792131.205305:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8998039c-e054-49d5-8067-ce5c17a03855+6:18737:x1875683760566400:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788792131.205817:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792131.205849:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36847 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67673 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.205990:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3684e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206006:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3684e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206019:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3684e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206032:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f36855 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206040:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f36855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206047:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f36855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206339:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030000/0x4d37c11031f3685c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206348:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030000/0x4d37c11031f3685c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206356:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030000/0x4d37c11031f3685c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788792131.206404:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788792131.206410:0:22666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788792131.206439:0:22666:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030000/0x4d37c11031f3685c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206466:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3684e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206473:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3684e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206480:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3684e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206486:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140031800 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792131.206492:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3684e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206503:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3684e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206519:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6170db3100) 00010000:00010000:2.0:1788792131.206523:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792131.206527:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3684e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206534:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3684e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206548:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f36855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206554:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f36855 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206559:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f36855 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206569:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140031c00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792131.206573:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f36855 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206579:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f36855 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206588:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8c61435aff00) 00010000:00010000:2.0:1788792131.206590:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792131.206593:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f36855 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206599:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f36855 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206629:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36847 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67673 expref: 8 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206645:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030000/0x4d37c11031f3685c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67673 expref: 7 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.206652:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c6042484200) 00010000:00010000:2.0:1788792131.206654:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788792131.206656:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140030000, rc 0) 00000100:00100000:2.0:1788792131.206866:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8998039c-e054-49d5-8067-ce5c17a03855+7:18737:x1875683760566400:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1561us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792131.206915:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:1.0:1788792131.220118:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792131.220255:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760566528 00000100:00100000:2.0:1788792131.220294:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760566528 00000100:00100000:2.0:1788792131.220377:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:2.0:1788792131.220390:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8998039c-e054-49d5-8067-ce5c17a03855+5:18737:x1875683760566528:12345-192.168.201.20@tcp:900:lfs.0 00000100:00100000:2.0:1788792131.220489:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8998039c-e054-49d5-8067-ce5c17a03855+5:18737:x1875683760566528:12345-192.168.201.20@tcp:900:lfs.0 Request processed in 102us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792131.220498:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00080000:3.0:1788792131.220577:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1788792131.225163:0:23423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788792131.228033:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792131.229605:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760566784 00000100:00100000:2.0:1788792131.229625:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760566784 00000100:00100000:2.0:1788792131.229713:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:2.0:1788792131.229725:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8998039c-e054-49d5-8067-ce5c17a03855+7:18737:x1875683760566784:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788792131.229758:0:24649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792131.229783:0:24649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36863 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c6767a expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788792131.229978:0:24649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788792131.230219:0:24649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36863 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6767a expref: 9 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.230236:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6170db3100) 00010000:00010000:2.0:1788792131.230240:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788792131.230246:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36863 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6767a expref: 9 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.230264:0:24649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140030c00, rc 0) 00000100:00100000:2.0:1788792131.230432:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8998039c-e054-49d5-8067-ce5c17a03855+8:18737:x1875683760566784:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 709us (2411us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788792131.230460:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:1.0:1788792131.239436:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792131.239521:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760567040 00000100:00100000:3.0:1788792131.239538:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760567040 00000100:00100000:3.0:1788792131.239621:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:3.0:1788792131.239633:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8998039c-e054-49d5-8067-ce5c17a03855+8:18737:x1875683760567040:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:3.0:1788792131.239702:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788792131.239752:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030000/0x4d37c11031f3685c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67673 expref: 8 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.239780:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c6042484200) 00010000:00010000:3.0:1788792131.239806:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788792131.239838:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa600/0x4d37c11031f36871 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.239853:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa600/0x4d37c11031f36871 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.239864:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa600/0x4d37c11031f36871 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788792131.240182:0:22665:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000036715ae0 reply state 0000000006107d11 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa600/0x4d37c11031f36871 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.240207:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa600/0x4d37c11031f36871 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.240214:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c6042484200) 00010000:00010000:3.0:1788792131.240217:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788792131.240220:0:22665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788792131.240229:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788792131.240327:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8998039c-e054-49d5-8067-ce5c17a03855+9:18737:x1875683760567040:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 695us (906us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788792131.240334:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:0.0:1788792131.245270:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792131.245426:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760567296 00000100:00100000:3.0:1788792131.245440:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760567296 00000100:00100000:3.0:1788792131.245635:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:3.0:1788792131.245648:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8998039c-e054-49d5-8067-ce5c17a03855+9:18737:x1875683760567296:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1788792131.246017:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8998039c-e054-49d5-8067-ce5c17a03855+10:18737:x1875683760567296:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 368us (756us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788792131.246024:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:1.0:1788792131.250780:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792131.250839:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760567552 00000100:00100000:2.0:1788792131.250853:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760567552 00000100:00100000:2.0:1788792131.250952:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:2.0:1788792131.250965:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8998039c-e054-49d5-8067-ce5c17a03855+10:18737:x1875683760567552:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788792131.251596:0:24649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792131.251624:0:24649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36878 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67681 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.251722:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3687f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.251751:0:24649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3687f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.251776:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3687f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.251790:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f36886 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.251798:0:24649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f36886 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.251804:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f36886 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788792131.251967:0:24649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788792131.252782:0:24649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3687f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.252816:0:24649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3687f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.252823:0:24649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3687f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.252830:0:24649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140031c00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792131.252835:0:24649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3687f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.252843:0:24649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3687f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.252860:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6170db3100) 00010000:00010000:2.0:1788792131.252863:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792131.252869:0:24649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3687f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.252923:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031c00/0x4d37c11031f3687f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.252941:0:24649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f36886 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.252946:0:24649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f36886 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.252953:0:24649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f36886 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.252958:0:24649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6140031800 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792131.252967:0:24649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f36886 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.252974:0:24649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f36886 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.253643:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8c61435aff00) 00010000:00010000:2.0:1788792131.253647:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792131.253652:0:24649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f36886 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.253659:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f36886 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.253714:0:24649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36878 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67681 expref: 12 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.253725:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6170db3100) 00010000:00010000:2.0:1788792131.253728:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788792131.253731:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36878 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67681 expref: 12 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.253803:0:24649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140030c00, rc 0) 00000100:00100000:2.0:1788792131.254004:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8998039c-e054-49d5-8067-ce5c17a03855+11:18737:x1875683760567552:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 3038us (3237us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788792131.254015:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:1.0:1788792131.261730:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792131.262050:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760567680 00000100:00100000:2.0:1788792131.262065:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760567680 00000100:00100000:2.0:1788792131.262400:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:2.0:1788792131.262413:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8998039c-e054-49d5-8067-ce5c17a03855+11:18737:x1875683760567680:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788792131.262478:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792131.262508:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36894 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67688 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.262651:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3689b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.262667:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3689b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.262681:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3689b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788792131.262711:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788792131.262716:0:22666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788792131.262752:0:22666:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3689b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.262781:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140030c00/0x4d37c11031f36894 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67688 expref: 13 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.262803:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3689b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67688 expref: 12 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.262813:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c6042484200) 00010000:00010000:2.0:1788792131.262816:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788792131.262820:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140031800, rc 0) 00000100:00100000:2.0:1788792131.262967:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8998039c-e054-49d5-8067-ce5c17a03855+12:18737:x1875683760567680:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 557us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792131.262975:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:0.0:1788792131.269583:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792131.269722:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760567808 00000100:00100000:2.0:1788792131.269744:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760567808 00000100:00100000:2.0:1788792131.269812:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:2.0:1788792131.269824:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8998039c-e054-49d5-8067-ce5c17a03855+12:18737:x1875683760567808:12345-192.168.201.20@tcp:37:lfs.0 00000100:00100000:1.0:1788792131.275913:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8998039c-e054-49d5-8067-ce5c17a03855+12:18737:x1875683760567808:12345-192.168.201.20@tcp:37:lfs.0 Request processed in 6038us (6290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792131.275933:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:1.0:1788792131.281819:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792131.282070:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760568064 00000100:00100000:3.0:1788792131.282082:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760568064 00000100:00100000:2.0:1788792131.282470:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:2.0:1788792131.282482:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043e3e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8998039c-e054-49d5-8067-ce5c17a03855+12:18737:x1875683760568064:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1788792131.282715:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043e3e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8998039c-e054-49d5-8067-ce5c17a03855+13:18737:x1875683760568064:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 234us (908us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788792131.282723:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:0.0:1788792131.296581:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792131.297032:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760568192 00000100:00100000:2.0:1788792131.297046:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760568192 00000100:00100000:2.0:1788792131.297123:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 160 00000100:00100000:2.0:1788792131.297136:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+11:18100:x1875683760568192:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788792131.297156:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792131.297177:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6140030c00/0x4d37c11031f368a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c6768f expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.297230:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6140030c00/0x4d37c11031f368a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6768f expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.297243:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6140030c00/0x4d37c11031f368a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6768f expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.297255:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140030c00, rc 0) 00000100:00100000:2.0:1788792131.297339:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+12:18100:x1875683760568192:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 206us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792131.297347:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 160 00000100:00100000:0.0:1788792131.300459:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792131.300903:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760568320 00000100:00100000:1.0:1788792131.300917:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760568320 00000100:00100000:1.0:1788792131.300991:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 161 00000100:00100000:1.0:1788792131.301001:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+12:18100:x1875683760568320:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788792131.301202:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+12:18100:x1875683760568320:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 202us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792131.301219:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 161 00000100:00100000:1.0:1788792131.313803:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792131.314040:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760568448 00000100:00100000:3.0:1788792131.314055:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760568448 00000100:00100000:3.0:1788792131.314123:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 162 00000100:00100000:3.0:1788792131.314135:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+12:18100:x1875683760568448:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788792131.314340:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+12:18100:x1875683760568448:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 206us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792131.314349:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 162 00000100:00100000:0.0:1788792131.325316:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792131.325410:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760568576 00000100:00100000:2.0:1788792131.325421:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760568576 00000100:00100000:2.0:1788792131.325497:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 163 00000100:00100000:2.0:1788792131.325508:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+12:18100:x1875683760568576:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788792131.325539:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792131.325562:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c6140031c00/0x4d37c11031f368a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67696 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.325598:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c6140031c00/0x4d37c11031f368a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67696 expref: 13 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.325611:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c6140031c00/0x4d37c11031f368a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67696 expref: 13 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792131.325621:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6140031c00, rc 0) 00000100:00100000:2.0:1788792131.325690:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55156022-243d-49cf-9038-3cfcecfd35e3+13:18100:x1875683760568576:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 184us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792131.325698:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 163 00000100:00100000:0.0:1788792131.328414:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792131.328529:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760568704 00000100:00100000:1.0:1788792131.328539:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760568704 00000100:00100000:1.0:1788792131.328604:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 164 00000100:00100000:1.0:1788792131.328616:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+13:18100:x1875683760568704:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788792131.328798:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+13:18100:x1875683760568704:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 184us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792131.328806:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 164 00000100:00100000:1.0:1788792131.348024:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792131.348551:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760568832 00000100:00100000:3.0:1788792131.348567:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760568832 00000100:00100000:3.0:1788792131.348633:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 165 00000100:00100000:3.0:1788792131.348644:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+13:18100:x1875683760568832:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788792131.348807:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55156022-243d-49cf-9038-3cfcecfd35e3+13:18100:x1875683760568832:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 163us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792131.348814:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 165 00000100:00100000:0.0:1788792131.369484:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792131.371503:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792131.371554:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792131.371589:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792131.371674:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760569344 00000100:00100000:2.0:1788792131.371687:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760569344 00000100:00100000:2.0:1788792131.371779:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760569600 00000100:00100000:2.0:1788792131.371783:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760569600 00000100:00100000:2.0:1788792131.371811:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:2.0:1788792131.371821:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2419:x1875683760569344:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788792131.371926:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2419:x1875683760569344:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 106us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792131.371934:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:2.0:1788792131.371952:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:2.0:1788792131.371974:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8998039c-e054-49d5-8067-ce5c17a03855+5:2419:x1875683760569600:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788792131.372000:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8998039c-e054-49d5-8067-ce5c17a03855+5:2419:x1875683760569600:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792131.372005:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00080000:2.0:1788792131.372027:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788792131.393477:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792131.395398:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792131.395642:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792131.395689:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760569088 00000100:00100000:1.0:1788792131.395718:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760569088 00000100:00100000:3.0:1788792131.395864:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760569216 00000100:00100000:3.0:1788792131.395869:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760569216 00000100:00100000:3.0:1788792131.395938:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760569472 00000100:00100000:3.0:1788792131.395942:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760569472 00000100:00100000:3.0:1788792131.395966:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:3.0:1788792131.395977:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2419:x1875683760569216:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788792131.396064:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2419:x1875683760569216:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 88us (2597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792131.396073:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:3.0:1788792131.396104:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:3.0:1788792131.396111:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6170109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8998039c-e054-49d5-8067-ce5c17a03855+5:2419:x1875683760569472:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788792131.396142:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6170109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8998039c-e054-49d5-8067-ce5c17a03855+5:2419:x1875683760569472:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 32us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792131.396148:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00080000:3.0:1788792131.396333:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788792131.401946:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760568960 00000100:00100000:2.0:1788792131.401966:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760568960 00000100:00100000:2.0:1788792131.402037:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:2.0:1788792131.402050:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2419:x1875683760569088:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788792131.402169:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2419:x1875683760569088:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 122us (32696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792131.402177:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:2.0:1788792131.403916:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:2.0:1788792131.403939:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+11:2419:x1875683760568960:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788792131.404023:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+11:2419:x1875683760568960:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 94us (32432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792131.404031:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:1.0:1788792131.404990:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760569728 00000100:00100000:1.0:1788792131.405003:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760569728 00000100:00100000:1.0:1788792131.405050:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:1.0:1788792131.405060:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+11:18744:x1875683760569728:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:1.0:1788792131.405094:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788792131.405121:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f368b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c6769d expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405200:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f368b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405220:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f368b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405235:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f368b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405249:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f368be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405257:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f368be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405264:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f368be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405365:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f368c5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405374:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f368c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405403:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f368c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788792131.405440:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788792131.405445:0:22664:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788792131.405501:0:22664:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f368c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405516:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f368b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405534:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f368b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405541:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f368b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405547:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689000 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:1.0:1788792131.405552:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f368b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405559:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f368b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405573:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6170db3100) 00010000:00010000:1.0:1788792131.405577:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788792131.405582:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f368b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405589:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f368b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405611:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f368be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405617:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f368be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405622:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f368be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405627:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689c00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:1.0:1788792131.405630:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f368be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405636:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f368be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405643:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8c61435aff00) 00010000:00010000:1.0:1788792131.405645:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788792131.405648:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f368be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405653:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f368be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405681:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f368b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6769d expref: 13 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405695:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688000/0x4d37c11031f368c5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6769d expref: 12 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.405715:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c6042484200) 00010000:00010000:1.0:1788792131.405717:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788792131.405719:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6141688000, rc 0) 00000100:00100000:1.0:1788792131.405784:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+12:18744:x1875683760569728:12345-192.168.201.20@tcp:101:bash.0 Request processed in 726us (10266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792131.405790:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:2.0:1788792131.421680:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792131.425834:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760569856 00000100:00100000:1.0:1788792131.425855:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760569856 00000100:00100000:1.0:1788792131.426703:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:1.0:1788792131.426720:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:18744:x1875683760569856:12345-192.168.201.20@tcp:900:bash.0 00000100:00100000:1.0:1788792131.426861:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:18744:x1875683760569856:12345-192.168.201.20@tcp:900:bash.0 Request processed in 146us (5192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792131.426869:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:2.0:1788792131.434147:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792131.434300:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760570112 00000100:00100000:3.0:1788792131.434315:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760570112 00000100:00100000:3.0:1788792131.434397:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:3.0:1788792131.434411:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+12:18744:x1875683760570112:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1788792131.434440:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792131.434479:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f368cc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c676a4 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.434641:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.434659:0:22664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3689b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67688 expref: 12 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.434669:0:22664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.434716:0:22664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3689b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67688 expref: 12 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.434744:0:22664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3689b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67688 expref: 12 pid: 22666 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792131.434761:0:22664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22664:1875683785852160:192.168.201.20@tcp:104: 00000100:00100000:3.0:1788792131.434869:0:22664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c616d3f76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788792131.446937:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792131.447580:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760570240 00000100:00100000:0.0:1788792131.447593:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760570240 00010000:00010000:0.0:1788792131.447643:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3689b lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67688 expref: 13 pid: 22666 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792131.447695:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:0.0:1788792131.447723:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8998039c-e054-49d5-8067-ce5c17a03855+13:2419:x1875683760570240:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788792131.447750:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788792131.447758:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3689b lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67688 expref: 13 pid: 22666 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.447772:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3689b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67688 expref: 13 pid: 22666 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.447795:0:22650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c6042484200) 00010000:00010000:0.0:1788792131.447801:0:22650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.447811:0:22650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.447819:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.447839:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788792131.447926:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8998039c-e054-49d5-8067-ce5c17a03855+13:2419:x1875683760570240:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 206us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792131.447935:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00010000:00010000:3.0:1788792131.449627:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6140031800/0x4d37c11031f3689b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67688 expref: 12 pid: 22666 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792131.449655:0:22664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22664:1875683785852160:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788792131.449680:0:22664:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.449692:0:22664:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.449698:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.449805:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aac00/0x4d37c11031f368da lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.449822:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aac00/0x4d37c11031f368da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.449835:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aac00/0x4d37c11031f368da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.451073:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f368e1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.451621:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f368e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.451634:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f368e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788792131.451669:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788792131.451703:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.451712:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.451720:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.451738:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413aa200 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:3.0:1788792131.451742:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.451750:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.451764:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c6042484200) 00010000:00010000:3.0:1788792131.451768:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788792131.451773:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.451779:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368d3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788792131.451795:0:22664:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000007a91c386 reply state 000000005aad860a transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aac00/0x4d37c11031f368da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.451806:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aac00/0x4d37c11031f368da lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.451824:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8c6144cc3f00) 00010000:00010000:3.0:1788792131.451826:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788792131.451829:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788792131.451870:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f368cc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676a4 expref: 15 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.451922:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f368e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676a4 expref: 14 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.451931:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:3.0:1788792131.451933:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788792131.451936:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c61413ab600, rc 0) 00000100:00100000:3.0:1788792131.452009:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+15:18744:x1875683760570112:12345-192.168.201.20@tcp:101:bash.0 Request processed in 17601us (17873us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788792131.452018:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:2.0:1788792131.489260:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792131.489473:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760570368 00000100:00100000:3.0:1788792131.489488:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760570368 00000100:00100000:3.0:1788792131.489588:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:3.0:1788792131.489605:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+15:18744:x1875683760570368:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1788792131.489643:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792131.489673:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f368ef lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c676ab expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.489788:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368f6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.489805:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.489839:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788792131.489951:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788792131.489956:0:22665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788792131.489981:0:22665:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.489995:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.490024:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f368ef lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ab expref: 17 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.490051:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ab expref: 16 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.490062:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:3.0:1788792131.490066:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788792131.490070:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c61413aa200, rc 0) 00000100:00100000:3.0:1788792131.490157:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+16:18744:x1875683760570368:12345-192.168.201.20@tcp:101:bash.0 Request processed in 557us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792131.490165:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:2.0:1788792131.500677:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792131.500867:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760570624 00000100:00100000:1.0:1788792131.500934:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760570624 00000100:00100000:1.0:1788792131.501013:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:1.0:1788792131.501028:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+16:18744:x1875683760570624:12345-192.168.201.20@tcp:35:bash.0 00000100:00100000:1.0:1788792131.501472:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+17:18744:x1875683760570624:12345-192.168.201.20@tcp:35:bash.0 Request processed in 447us (814us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788792131.501483:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:3.0:1788792131.607915:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785852288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788792131.608002:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792131.608330:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785852800:0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.608366:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792131.608389:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875683785853312:0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.608413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792131.608431:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788792131.608437:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785852416:0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.608493:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792131.608521:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785852928:0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.608547:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792131.608567:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875683785853440:0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.608592:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792131.608621:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785852928 00000100:00100000:0.0:1788792131.608630:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785852928 00000100:00100000:0.0:1788792131.608687:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788792131.608700:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785852928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.608933:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785852928:12345-0@lo:400:kworker.0 Request processed in 234us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792131.608943:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788792131.608968:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785852544:0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.608993:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792131.609008:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875683785853056:0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.609025:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792131.609038:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875683785853568:0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.609057:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792131.609068:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788792131.609073:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785852672:0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.609094:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792131.609108:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61608c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875683785853184:0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.609124:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792131.609163:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785852928:0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.609196:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785852800 00000100:00100000:0.0:1788792131.609200:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785852800 00000100:00100000:0.0:1788792131.609220:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785853312 00000100:00100000:0.0:1788792131.609224:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785853312 00000100:00100000:0.0:1788792131.609246:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785853440 00000100:00100000:0.0:1788792131.609248:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785853440 00000100:00100000:0.0:1788792131.609262:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785853056 00000100:00100000:0.0:1788792131.609264:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785853056 00000100:00100000:0.0:1788792131.609274:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785853568 00000100:00100000:0.0:1788792131.609285:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785853568 00000100:00100000:0.0:1788792131.609299:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785853184 00000100:00100000:0.0:1788792131.609301:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785853184 00000100:00100000:0.0:1788792131.609315:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788792131.609323:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785852800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.609365:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875683785852800:12345-0@lo:400:kworker.0 Request processed in 43us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792131.609372:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788792131.609384:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788792131.609390:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875683785853312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.609418:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875683785853312:12345-0@lo:400:kworker.0 Request processed in 29us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792131.609424:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788792131.609435:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00010000:00010000:3.0:1788792131.609538:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788792131.609549:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785852544 00000100:00100000:3.0:1788792131.609553:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785852544 00000100:00100000:3.0:1788792131.609587:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788792131.609593:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785852544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792131.609628:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785852544:12345-0@lo:400:kworker.0 Request processed in 35us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792131.609633:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788792131.609651:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788792131.609655:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788792131.609664:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785852672 00000100:00100000:3.0:1788792131.609667:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785852672 00000100:00100000:3.0:1788792131.609690:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788792131.609695:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617faf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785852672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792131.609719:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617faf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785852672:12345-0@lo:400:kworker.0 Request processed in 24us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792131.609724:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788792131.609752:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788792131.609760:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788792131.609767:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875683785853056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792131.609790:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875683785853056:12345-0@lo:400:kworker.0 Request processed in 24us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792131.609795:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788792131.609805:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788792131.609810:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617fafb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875683785853568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792131.609829:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617fafb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875683785853568:12345-0@lo:400:kworker.0 Request processed in 19us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792131.609834:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788792131.609842:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788792131.609847:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617faf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875683785853184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792131.609890:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617faf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875683785853184:12345-0@lo:400:kworker.0 Request processed in 43us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792131.609896:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788792131.609942:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875683785852800:0@lo:400:kworker.0 00010000:00080000:3.0:1788792131.609954:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c61608c1180 x1875683785853312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792131.609965:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875683785853312:0@lo:400:kworker.0 00000100:00100000:3.0:1788792131.609999:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785852672:0@lo:400:kworker.0 00000100:00100000:3.0:1788792131.610008:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875683785853184:0@lo:400:kworker.0 00000100:00100000:3.0:1788792131.610018:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785852544:0@lo:400:kworker.0 00000100:00100000:3.0:1788792131.610029:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875683785853056:0@lo:400:kworker.0 00010000:00080000:3.0:1788792131.610056:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c61608c0700 x1875683785853568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792131.610066:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875683785853568:0@lo:400:kworker.0 00000100:00100000:1.0:1788792131.610570:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785852288 00000100:00100000:1.0:1788792131.610578:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785852288 00000100:00100000:1.0:1788792131.610650:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788792131.610660:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785852288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788792131.610708:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788792131.610775:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785852288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (2772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792131.610781:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788792131.610829:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785852288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788792131.611613:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785852416 00000100:00100000:2.0:1788792131.611621:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785852416 00000100:00100000:2.0:1788792131.611662:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788792131.611670:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6181be7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+24:3641:x1875683785852416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792131.611757:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6181be7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a140336d-9a80-41e1-97b0-93600c05b204+24:3641:x1875683785852416:12345-0@lo:400:kworker.0 Request processed in 88us (3263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792131.611763:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788792131.611933:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875683785853440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792131.611973:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875683785853440:12345-0@lo:400:kworker.0 Request processed in 2532us (3380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792131.611981:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788792131.612508:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a140336d-9a80-41e1-97b0-93600c05b204:3641:1875683785852416:0@lo:400:kworker.0 00000100:00100000:1.0:1788792131.612525:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61608c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875683785853440:0@lo:400:kworker.0 00000100:00100000:2.0:1788792131.612653:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788792131.612672:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785853696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788792131.612720:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792131.612940:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785853696 00000100:00100000:1.0:1788792131.612947:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785853696 00000100:00100000:1.0:1788792131.612998:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788792131.613009:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785853696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788792131.613030:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788792131.613075:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785853696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792131.613081:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788792131.613374:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785853696:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788792131.613837:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788792131.648957:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792131.649060:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760570880 00000100:00100000:3.0:1788792131.649073:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760570880 00000100:00100000:3.0:1788792131.649144:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:3.0:1788792131.649156:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+17:18755:x1875683760570880:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1788792131.649197:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792131.649222:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f368fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c676b2 expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788792131.649393:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788792131.649691:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f368fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676b2 expref: 19 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.649710:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6170db3100) 00010000:00010000:3.0:1788792131.649714:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788792131.649720:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f368fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676b2 expref: 19 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.649742:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c61413aa000, rc 0) 00000100:00100000:3.0:1788792131.649831:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+18:18755:x1875683760570880:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 676us (887us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1788792131.649839:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:0.0:1788792131.653017:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792131.653300:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760571136 00000100:00100000:1.0:1788792131.653318:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760571136 00000100:00100000:1.0:1788792131.653405:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:1.0:1788792131.653418:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617faf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+18:18755:x1875683760571136:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1788792131.653780:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617faf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+19:18755:x1875683760571136:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 363us (776us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788792131.653789:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:2.0:1788792131.701006:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792131.701266:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760571392 00000100:00100000:0.0:1788792131.701292:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760571392 00000100:00100000:0.0:1788792131.701379:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:0.0:1788792131.701392:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+19:18758:x1875683760571392:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788792131.701430:0:24649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788792131.701467:0:24649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f3690b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c676b9 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.701604:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f36912 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.701622:0:24649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f36912 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.701637:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f36912 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788792131.701650:0:24649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788792131.701784:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f3690b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676b9 expref: 22 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.701806:0:24649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f36912 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676b9 expref: 21 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792131.701815:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:0.0:1788792131.701818:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788792131.701822:0:24649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c615086d400, rc 0) 00000100:00100000:0.0:1788792131.701975:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+21:18758:x1875683760571392:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 586us (982us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788792131.702004:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:0.0:1788792131.707825:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792131.707918:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792131.708064:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760571520 00000100:00100000:3.0:1788792131.708085:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760571520 00000100:00100000:3.0:1788792131.708167:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:3.0:1788792131.708180:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617faf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+21:18758:x1875683760571520:12345-192.168.201.20@tcp:54:lfs.0 00010000:00010000:3.0:1788792131.708327:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36920 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.708351:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36920 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.708366:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36920 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.708415:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36920 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.708440:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36920 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.708448:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36920 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.708454:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413aa000 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:3.0:1788792131.708459:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36920 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.708467:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36920 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.708484:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:3.0:1788792131.708487:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788792131.708493:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36920 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792131.708499:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36920 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792131.708589:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617faf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+21:18758:x1875683760571520:12345-192.168.201.20@tcp:54:lfs.0 Request processed in 409us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792131.708598:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:1.0:1788792131.709910:0:25006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760571648 00000100:00100000:1.0:1788792131.709924:0:25006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760571648 00000100:00100000:1.0:1788792131.710003:0:25006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:1.0:1788792131.710012:0:25006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617faf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+21:2420:x1875683760571648:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788792131.710029:0:25006:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788792131.710057:0:25006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f36912 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676b9 expref: 21 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792131.710079:0:25006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:1.0:1788792131.710084:0:25006:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788792131.710142:0:25006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617faf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+20:2420:x1875683760571648:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 132us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792131.710150:0:25006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:1.0:1788792131.713394:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792131.714429:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760571904 00000100:00100000:0.0:1788792131.714449:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760571904 00000100:00100000:0.0:1788792131.714537:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1788792131.714560:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+20:18758:x1875683760571904:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:0.0:1788792131.714846:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+21:18758:x1875683760571904:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 289us (1466us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788792131.714854:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:2.0:1788792132.119732:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617faf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785853952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788792132.119818:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788792132.119902:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788792132.119902:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785853952 00000100:00100000:2.0:1788792132.119911:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785853824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788792132.119914:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785853952 00000100:00100000:2.0:1788792132.119935:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792132.119960:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785853824 00000100:00100000:0.0:1788792132.119964:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785853824 00000100:00100000:0.0:1788792132.119982:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788792132.120042:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785853952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788792132.120087:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788792132.120142:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785853952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792132.127120:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788792132.127159:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785853824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788792132.127222:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788792132.127339:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875683785853824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 201us (7402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792132.127349:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788792132.127436:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875683785853824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788792132.127458:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617faf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785853952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788792132.131978:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788792132.157546:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792132.157778:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760572160 00000100:00100000:0.0:1788792132.157794:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760572160 00000100:00100000:0.0:1788792132.158046:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:0.0:1788792132.158059:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+21:18789:x1875683760572160:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:0.0:1788792132.158092:0:24649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788792132.158117:0:24649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f36927 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c676c0 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.158329:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f3692e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.158348:0:24649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f3692e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.158367:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f3692e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788792132.158382:0:24649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788792132.158543:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f36927 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676c0 expref: 24 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.158576:0:24649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f3692e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676c0 expref: 23 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.158587:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:0.0:1788792132.158591:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788792132.158595:0:24649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c615086cc00, rc 0) 00000100:00100000:0.0:1788792132.158670:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+23:18789:x1875683760572160:12345-192.168.201.20@tcp:101:cat.0 Request processed in 613us (1142us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1788792132.158678:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00080000:3.0:1788792132.162753:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788792132.164301:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792132.164452:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760572416 00000100:00100000:1.0:1788792132.164466:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760572416 00000100:00100000:1.0:1788792132.164536:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:1.0:1788792132.164549:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+23:18789:x1875683760572416:12345-192.168.201.20@tcp:35:cat.0 00000100:00100000:1.0:1788792132.165076:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+24:18789:x1875683760572416:12345-192.168.201.20@tcp:35:cat.0 Request processed in 528us (787us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788792132.165084:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:1.0:1788792132.171265:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792132.174341:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760572544 00000100:00100000:0.0:1788792132.174365:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760572544 00000100:00100000:0.0:1788792132.174656:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:0.0:1788792132.174671:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+24:2421:x1875683760572544:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788792132.174692:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788792132.175075:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f3692e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676c0 expref: 24 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.175097:0:22650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:0.0:1788792132.175102:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788792132.175181:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+23:2421:x1875683760572544:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 513us (3926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792132.175970:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00000040:00080000:2.0:1788792132.247947:0:23423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788792132.263976:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792132.264389:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760572800 00000100:00100000:3.0:1788792132.264400:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760572800 00000100:00100000:3.0:1788792132.264461:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:3.0:1788792132.264473:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+23:18795:x1875683760572800:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788792132.264532:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792132.264564:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f3693c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c676c7 expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792132.264732:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36943 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792132.264750:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36943 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792132.264763:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36943 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788792132.264777:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788792132.264954:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f3693c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676c7 expref: 26 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792132.264976:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36943 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676c7 expref: 25 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792132.264982:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:3.0:1788792132.264984:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788792132.264987:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c61413aba00, rc 0) 00000100:00100000:2.0:1788792132.265149:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+25:18795:x1875683760572800:12345-192.168.201.20@tcp:101:dd.0 Request processed in 677us (1182us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788792132.265158:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:2.0:1788792132.276080:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792132.276209:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792132.276349:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760572928 00000100:00100000:0.0:1788792132.276363:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760572928 00000100:00100000:0.0:1788792132.276443:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:0.0:1788792132.276455:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+25:18795:x1875683760572928:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788792132.276487:0:24649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788792132.276514:0:24649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36951 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c676ce expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.276555:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f36958 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.276571:0:24649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f36958 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.276596:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f36958 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.276728:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36951 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ce expref: 27 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.276749:0:24649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f36958 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ce expref: 26 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.276766:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:0.0:1788792132.276769:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788792132.276773:0:24649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c615086da00, rc 0) 00000100:00100000:0.0:1788792132.276846:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+26:18795:x1875683760572928:12345-192.168.201.20@tcp:101:dd.0 Request processed in 392us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792132.276854:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:1.0:1788792132.277831:0:25006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760573056 00000100:00100000:1.0:1788792132.277844:0:25006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760573056 00000100:00100000:0.0:1788792132.278142:0:25006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:0.0:1788792132.278154:0:25006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+26:2420:x1875683760573056:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788792132.278168:0:25006:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788792132.278382:0:25006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36943 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676c7 expref: 26 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.278403:0:25006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:0.0:1788792132.278408:0:25006:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788792132.278510:0:25006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+25:2420:x1875683760573056:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 357us (2300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792132.278518:0:25006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:2.0:1788792132.282210:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792132.283941:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760573312 00000100:00100000:0.0:1788792132.283955:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760573312 00000100:00100000:0.0:1788792132.284053:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:0.0:1788792132.284065:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+25:18795:x1875683760573312:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:0.0:1788792132.284129:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788792132.284160:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f368f6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ab expref: 25 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.284340:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:0.0:1788792132.284346:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788792132.284555:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f3695f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.284569:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f3695f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.284698:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f3695f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788792132.284813:0:22664:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1788792132.284840:0:22664:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000004750d300 reply state 0000000072cf8efc transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f3695f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.284854:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f3695f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.284860:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:0.0:1788792132.284863:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788792132.284866:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788792132.284997:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+27:18795:x1875683760573312:12345-192.168.201.20@tcp:36:dd.0 Request processed in 933us (2813us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788792132.285005:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 45 00000020:00080000:0.0:1788792132.285011:0:22664:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788792132.384693:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792132.384932:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760573568 00000100:00100000:0.0:1788792132.384944:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760573568 00000100:00100000:0.0:1788792132.385004:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:0.0:1788792132.385017:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+27:18795:x1875683760573568:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:0.0:1788792132.385372:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+28:18795:x1875683760573568:12345-192.168.201.20@tcp:35:dd.0 Request processed in 357us (688us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1788792132.385380:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:3.0:1788792132.605540:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792132.606582:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760573696 00000100:00100000:0.0:1788792132.606595:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760573696 00000100:00100000:0.0:1788792132.606777:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:0.0:1788792132.606792:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+28:18809:x1875683760573696:12345-192.168.201.20@tcp:101:stat.0 00010000:00010000:0.0:1788792132.606817:0:24649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788792132.606841:0:24649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36966 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c676d5 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607006:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f3696d lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607022:0:24649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f3696d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607035:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f3696d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607048:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36974 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607055:0:24649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36974 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607062:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36974 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607143:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c200/0x4d37c11031f3697b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607166:0:24649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c200/0x4d37c11031f3697b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607174:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c200/0x4d37c11031f3697b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788792132.607293:0:24649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788792132.607297:0:24649:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788792132.607346:0:24649:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c200/0x4d37c11031f3697b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607361:0:24649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c200/0x4d37c11031f3697b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607370:0:24649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f3696d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607376:0:24649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f3696d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607384:0:24649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f3696d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607390:0:24649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086d400 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:0.0:1788792132.607395:0:24649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f3696d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607402:0:24649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f3696d lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607413:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c6042484200) 00010000:00010000:0.0:1788792132.607489:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788792132.607495:0:24649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f3696d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607503:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f3696d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607519:0:24649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36974 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607526:0:24649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36974 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607533:0:24649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36974 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607538:0:24649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086d000 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:0.0:1788792132.607541:0:24649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36974 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607547:0:24649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36974 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607556:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8c6144cc3f00) 00010000:00010000:0.0:1788792132.607559:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788792132.607562:0:24649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36974 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607568:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36974 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607597:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36966 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676d5 expref: 30 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607624:0:24649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c200/0x4d37c11031f3697b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676d5 expref: 29 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792132.607632:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:0.0:1788792132.607634:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788792132.607636:0:24649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c615086c200, rc 0) 00000100:00100000:0.0:1788792132.607836:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+29:18809:x1875683760573696:12345-192.168.201.20@tcp:101:stat.0 Request processed in 1046us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792132.607845:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 46 00010000:00010000:1.0:1788792132.630204:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788792132.711669:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792132.712089:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760573952 00000100:00100000:3.0:1788792132.712099:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760573952 00000100:00100000:3.0:1788792132.712165:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00100000:3.0:1788792132.712175:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+29:18815:x1875683760573952:12345-192.168.201.20@tcp:36:truncate.0 00010000:00010000:3.0:1788792132.712462:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788792132.712511:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c200/0x4d37c11031f3697b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676d5 expref: 29 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792132.712532:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:3.0:1788792132.712537:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788792132.712846:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36982 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792132.713044:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36982 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792132.713066:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36982 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788792132.713122:0:22665:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:3.0:1788792132.713144:0:22665:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000080e68975 reply state 0000000089a12991 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36982 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792132.713156:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36982 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792132.713163:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:3.0:1788792132.713165:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788792132.713168:0:22665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788792132.713372:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+31:18815:x1875683760573952:12345-192.168.201.20@tcp:36:truncate.0 Request processed in 1196us (1713us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1788792132.713380:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 47 00000020:00080000:3.0:1788792132.713385:0:22665:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788792132.926974:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792132.927324:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760574080 00000100:00100000:2.0:1788792132.927342:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760574080 00000100:00100000:2.0:1788792132.927424:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:2.0:1788792132.927436:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+31:18829:x1875683760574080:12345-192.168.201.20@tcp:101:stat.0 00010000:00010000:2.0:1788792132.927464:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792132.927486:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67a00/0x4d37c11031f36989 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c676dc expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927675:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67000/0x4d37c11031f36990 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927688:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67000/0x4d37c11031f36990 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927697:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67000/0x4d37c11031f36990 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927708:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67200/0x4d37c11031f36997 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927741:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67200/0x4d37c11031f36997 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927749:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67200/0x4d37c11031f36997 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927822:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66c00/0x4d37c11031f3699e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927828:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66c00/0x4d37c11031f3699e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927833:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66c00/0x4d37c11031f3699e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788792132.927870:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788792132.927896:0:22666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788792132.927922:0:22666:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66c00/0x4d37c11031f3699e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927931:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66c00/0x4d37c11031f3699e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927937:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67000/0x4d37c11031f36990 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927941:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67000/0x4d37c11031f36990 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927945:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67000/0x4d37c11031f36990 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927957:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e67000 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792132.927960:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67000/0x4d37c11031f36990 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927967:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67000/0x4d37c11031f36990 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927978:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c6042484200) 00010000:00010000:2.0:1788792132.927980:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792132.927984:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67000/0x4d37c11031f36990 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927988:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67000/0x4d37c11031f36990 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.927999:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67200/0x4d37c11031f36997 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.928003:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67200/0x4d37c11031f36997 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.928007:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67200/0x4d37c11031f36997 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.928010:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6174e67200 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792132.928012:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67200/0x4d37c11031f36997 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.928015:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67200/0x4d37c11031f36997 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.928025:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8c6144cc3f00) 00010000:00010000:2.0:1788792132.928026:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792132.928028:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67200/0x4d37c11031f36997 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.928031:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67200/0x4d37c11031f36997 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.928060:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67a00/0x4d37c11031f36989 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676dc expref: 33 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.928069:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66c00/0x4d37c11031f3699e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676dc expref: 32 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792132.928074:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:2.0:1788792132.928076:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788792132.928077:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6174e66c00, rc 0) 00000100:00100000:2.0:1788792132.928185:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+32:18829:x1875683760574080:12345-192.168.201.20@tcp:101:stat.0 Request processed in 751us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792132.928192:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:2.0:1788792133.042630:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792133.042749:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760574336 00000100:00100000:0.0:1788792133.042760:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760574336 00000100:00100000:0.0:1788792133.042825:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:0.0:1788792133.042836:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+32:18839:x1875683760574336:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788792133.042858:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788792133.042919:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f369a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c676e3 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788792133.043046:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788792133.043157:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f369a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676e3 expref: 34 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.043172:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6170db3100) 00010000:00010000:0.0:1788792133.043176:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788792133.043181:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f369a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676e3 expref: 34 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.043224:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c615086cc00, rc 0) 00000100:00100000:0.0:1788792133.043307:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+33:18839:x1875683760574336:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 473us (688us total) trans 12884901910 rc 301/301 00000100:00100000:0.0:1788792133.043315:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:1.0:1788792133.047513:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792133.047603:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760574592 00000100:00100000:0.0:1788792133.047615:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760574592 00000100:00100000:0.0:1788792133.047684:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:0.0:1788792133.047698:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043e3f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+33:18839:x1875683760574592:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:0.0:1788792133.048030:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043e3f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+34:18839:x1875683760574592:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 333us (528us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788792133.048039:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:2.0:1788792133.133412:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792133.133662:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760574848 00000100:00100000:0.0:1788792133.133677:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760574848 00000100:00100000:0.0:1788792133.133784:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00100000:0.0:1788792133.133798:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+34:18845:x1875683760574848:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1788792133.133833:0:24649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788792133.133861:0:24649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f369b3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c676ea expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.134048:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.134069:0:24649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f368e1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676a4 expref: 35 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.134108:0:24649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66c00/0x4d37c11031f3699e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676dc expref: 35 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.134119:0:24649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.134171:0:24649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66c00/0x4d37c11031f3699e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676dc expref: 35 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.134198:0:24649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66c00/0x4d37c11031f3699e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676dc expref: 35 pid: 22666 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792133.134214:0:24649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617faf8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24649:1875683785854080:192.168.201.20@tcp:104: 00010000:00010000:0.0:1788792133.134347:0:24649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f368e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676a4 expref: 35 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.134358:0:24649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f368e1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676a4 expref: 35 pid: 22664 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792133.134367:0:24649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617fafa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24649:1875683785854208:192.168.201.20@tcp:104: 00000100:00100000:0.0:1788792133.134391:0:24649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61509140c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788792133.139213:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792133.139269:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792133.139445:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760574976 00000100:00100000:1.0:1788792133.139458:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760574976 00010000:00010000:1.0:1788792133.139509:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66c00/0x4d37c11031f3699e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676dc expref: 36 pid: 22666 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792133.139568:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760575104 00000100:00100000:1.0:1788792133.139572:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760575104 00010000:00010000:1.0:1788792133.139586:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f368e1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676a4 expref: 37 pid: 22664 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792133.139610:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:1.0:1788792133.139619:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61812d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+37:2419:x1875683760574976:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788792133.139633:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788792133.139640:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66c00/0x4d37c11031f3699e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676dc expref: 37 pid: 22666 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792133.139654:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66c00/0x4d37c11031f3699e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676dc expref: 37 pid: 22666 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792133.139683:0:22650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:1.0:1788792133.139689:0:22650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792133.139711:0:22650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792133.139719:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788792133.139769:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61812d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+37:2419:x1875683760574976:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 150us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792133.139777:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 17 00000100:00100000:1.0:1788792133.139822:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:1.0:1788792133.139829:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+36:2419:x1875683760575104:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788792133.139841:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788792133.139847:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f368e1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676a4 expref: 36 pid: 22664 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792133.139858:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f368e1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676a4 expref: 36 pid: 22664 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792133.139870:0:22650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:1.0:1788792133.139915:0:22650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792133.139924:0:22650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792133.139932:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792133.139950:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788792133.139966:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+36:2419:x1875683760575104:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 138us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792133.139972:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00010000:00010000:0.0:1788792133.141129:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66c00/0x4d37c11031f3699e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676dc expref: 35 pid: 22666 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792133.141151:0:24649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617faf8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24649:1875683785854080:192.168.201.20@tcp:104: 00010000:00010000:0.0:1788792133.141185:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f368e1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676a4 expref: 34 pid: 22664 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792133.141215:0:24649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617fafa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24649:1875683785854208:192.168.201.20@tcp:104: 00010000:00010000:0.0:1788792133.141242:0:24649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.141262:0:24649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.141268:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788792133.141292:0:24649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788792133.141979:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f369b3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ea expref: 35 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.142001:0:24649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ea expref: 34 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.142012:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:0.0:1788792133.142015:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788792133.142019:0:24649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c615086d000, rc 0) 00000100:00100000:0.0:1788792133.142263:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+34:18845:x1875683760574848:12345-192.168.201.20@tcp:101:bash.0 Request processed in 8456us (8852us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1788792133.142274:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00100000:2.0:1788792133.149326:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792133.149409:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760575360 00000100:00100000:0.0:1788792133.149429:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760575360 00000100:00100000:0.0:1788792133.149514:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:0.0:1788792133.149525:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+34:18845:x1875683760575360:12345-192.168.201.20@tcp:36:bash.0 00010000:00010000:0.0:1788792133.149810:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f369c8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.149832:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f369c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.149844:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f369c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788792133.149931:0:22664:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:0.0:1788792133.149953:0:22664:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000bc0a3fb6 reply state 00000000fa279749 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f369c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.149967:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f369c8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.149975:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:0.0:1788792133.149979:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788792133.149983:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788792133.150093:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+37:18845:x1875683760575360:12345-192.168.201.20@tcp:36:bash.0 Request processed in 568us (778us total) trans 12884901914 rc 0/0 00000100:00100000:0.0:1788792133.150101:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 51 00000020:00080000:0.0:1788792133.150107:0:22664:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788792133.153617:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792133.153791:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760575488 00000100:00100000:2.0:1788792133.153803:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760575488 00000100:00100000:2.0:1788792133.153961:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:2.0:1788792133.153974:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+37:18845:x1875683760575488:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1788792133.154005:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792133.154032:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67e00/0x4d37c11031f369cf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c676f1 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792133.154108:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67e00/0x4d37c11031f369cf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676f1 expref: 38 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792133.154122:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67e00/0x4d37c11031f369cf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676f1 expref: 38 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792133.154142:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:2.0:1788792133.154145:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788792133.154149:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6174e67e00, rc 0) 00000100:00100000:2.0:1788792133.154355:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+38:18845:x1875683760575488:12345-192.168.201.20@tcp:101:bash.0 Request processed in 384us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792133.154363:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:3.0:1788792133.159206:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792133.160561:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760575616 00000100:00100000:0.0:1788792133.160576:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760575616 00000100:00100000:0.0:1788792133.160654:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:0.0:1788792133.160666:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+38:18845:x1875683760575616:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1788792133.160692:0:24649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788792133.160742:0:24649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f369d6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c676f8 expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.160865:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c600/0x4d37c11031f369dd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.160899:0:24649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ea expref: 39 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.160908:0:24649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c600/0x4d37c11031f369dd lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.160945:0:24649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ea expref: 39 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.160958:0:24649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ea expref: 39 pid: 24649 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792133.160971:0:24649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617fafa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24649:1875683785854336:192.168.201.20@tcp:104: 00000100:00100000:0.0:1788792133.161067:0:24649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6150914240 going to sleep for 11 seconds 00000100:00100000:0.0:1788792133.164691:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792133.164759:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760575744 00000100:00100000:0.0:1788792133.164772:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760575744 00010000:00010000:0.0:1788792133.164823:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ea expref: 40 pid: 24649 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792133.164866:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:0.0:1788792133.164900:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617faf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+40:2420:x1875683760575744:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788792133.164916:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788792133.164943:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ea expref: 40 pid: 24649 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.164957:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ea expref: 40 pid: 24649 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.164991:0:22650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:0.0:1788792133.164997:0:22650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c600/0x4d37c11031f369dd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.165009:0:22650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c600/0x4d37c11031f369dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.165017:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c600/0x4d37c11031f369dd lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792133.165039:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788792133.165109:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617faf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+40:2420:x1875683760575744:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 212us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792133.165118:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00010000:00010000:3.0:1788792133.166850:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f369ba lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ea expref: 39 pid: 24649 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792133.166917:0:24649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617fafa680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24649:1875683785854336:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788792133.166940:0:24649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c600/0x4d37c11031f369dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792133.166949:0:24649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c600/0x4d37c11031f369dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792133.166955:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c600/0x4d37c11031f369dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788792133.167014:0:24649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788792133.167019:0:24649:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788792133.167044:0:24649:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c600/0x4d37c11031f369dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792133.167293:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f369d6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676f8 expref: 39 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792133.167311:0:24649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c600/0x4d37c11031f369dd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676f8 expref: 38 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792133.167321:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:3.0:1788792133.167324:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788792133.167329:0:24649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c615086c600, rc 0) 00000100:00100000:3.0:1788792133.167405:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+38:18845:x1875683760575616:12345-192.168.201.20@tcp:101:bash.0 Request processed in 6740us (8219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792133.167480:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:0.0:1788792133.172282:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792133.172410:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760576000 00000100:00100000:2.0:1788792133.172489:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760576000 00000100:00100000:2.0:1788792133.172600:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:2.0:1788792133.172613:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617fafa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+38:18845:x1875683760576000:12345-192.168.201.20@tcp:103:bash.0 00010000:00010000:2.0:1788792133.172630:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788792133.172862:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67e00/0x4d37c11031f369cf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676f1 expref: 38 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792133.172910:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c600/0x4d37c11031f369dd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676f8 expref: 37 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792133.172938:0:22651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:2.0:1788792133.172943:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788792133.173059:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617fafa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+36:18845:x1875683760576000:12345-192.168.201.20@tcp:103:bash.0 Request processed in 440us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792133.173068:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:0.0:1788792133.176027:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792133.176138:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760576128 00000100:00100000:3.0:1788792133.176149:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760576128 00000100:00100000:3.0:1788792133.176226:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 54 00000100:00100000:3.0:1788792133.176237:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617fafaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+36:18845:x1875683760576128:12345-192.168.201.20@tcp:58:bash.0 00010000:00010000:3.0:1788792133.176370:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f369e4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792133.176388:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f369e4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792133.176400:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f369e4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788792133.178164:0:22665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788792133.178218:0:22665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1788792133.178454:0:22665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1788792133.178588:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617fafaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+36:18845:x1875683760576128:12345-192.168.201.20@tcp:58:bash.0 Request processed in 2343us (2562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792133.178600:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 54 00000100:00100000:0.0:1788792133.181291:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792133.181404:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760576256 00000100:00100000:3.0:1788792133.181479:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760576256 00000100:00100000:3.0:1788792133.181600:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 55 00000100:00100000:3.0:1788792133.181612:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617fafad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+36:18845:x1875683760576256:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1788792133.181639:0:24649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792133.181662:0:24649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f369eb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c676ff expref: -99 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792133.181722:0:24649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f369e4 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792133.181755:0:24649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f369eb lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ff expref: 37 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792133.181778:0:24649:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f369e4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792133.181792:0:24649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f369eb lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ff expref: 37 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792133.181808:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:3.0:1788792133.181811:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788792133.181815:0:24649:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f369eb lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ff expref: 37 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792133.181823:0:24649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c61413aa200, rc 0) 00000100:00100000:3.0:1788792133.181981:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617fafad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+37:18845:x1875683760576256:12345-192.168.201.20@tcp:101:bash.0 Request processed in 371us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792133.181989:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 55 00010000:00010000:3.0:1788792133.654457:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788792134.102810:0:22700:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788792134.102821:0:22700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788792134.102850:0:22700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788792134.102860:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788792134.103068:0:22700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c97b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22700:1875683785854464:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788792134.104887:0:22700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6153c3c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788792134.117927:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792134.118121:0:22700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c97b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22700:1875683785854464:192.168.201.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788792134.123381:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760576384 00000100:00100000:3.0:1788792134.123541:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760576384 00000100:00100000:3.0:1788792134.123751:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 56 00000100:00100000:3.0:1788792134.123765:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617fafb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+37:18846:x1875683760576384:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788792134.123801:0:22666:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788792134.124105:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617fafb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+37:18846:x1875683760576384:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 340us (6189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792134.124117:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 56 00000100:00080000:0.0:1788792134.127783:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788792134.135781:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792134.136347:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760576512 00000100:00100000:1.0:1788792134.136363:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760576512 00000100:00100000:1.0:1788792134.136439:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 57 00000100:00100000:1.0:1788792134.136450:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617faf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+37:18846:x1875683760576512:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788792134.136565:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f369f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136580:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f369f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136591:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f369f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136652:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f369f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136657:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f369f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136662:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f369f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136682:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a00 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136689:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136693:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788792134.136754:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788792134.136757:0:22664:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788792134.136771:0:22664:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136780:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f369f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136791:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f369f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136796:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f369f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136800:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689200 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:1.0:1788792134.136804:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f369f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136810:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f369f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136822:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c6042484700) 00010000:00010000:1.0:1788792134.136824:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788792134.136829:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f369f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136833:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f369f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136847:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f369f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136851:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f369f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136855:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f369f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136857:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689c00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:1.0:1788792134.136864:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f369f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136868:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f369f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136926:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8c6042484400) 00010000:00010000:1.0:1788792134.136928:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788792134.136930:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f369f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136933:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f369f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136945:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136949:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a00 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136953:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a00 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136956:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689000 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:1.0:1788792134.136957:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a00 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136960:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a00 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136964:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:1.0:1788792134.136965:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788792134.136971:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a00 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.136975:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a00 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792134.137060:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617faf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+37:18846:x1875683760576512:12345-192.168.201.20@tcp:34:lhsmtool_posix.0 Request processed in 610us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792134.137068:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 57 00000100:00100000:3.0:1788792134.153152:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792134.153372:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760576768 00000100:00100000:1.0:1788792134.153386:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760576768 00000100:00100000:1.0:1788792134.153472:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00100000:1.0:1788792134.153485:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+37:18846:x1875683760576768:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788792134.153514:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788792134.153543:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a07 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67706 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.153686:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f36a0e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.153707:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f36a0e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.153721:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f36a0e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788792134.153735:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788792134.153825:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f36a0e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.153834:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f36a0e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.153862:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f36a0e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.153868:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689c00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:1.0:1788792134.153916:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f36a0e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.153927:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f36a0e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.153943:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:1.0:1788792134.153947:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788792134.153953:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f36a0e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.153960:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f36a0e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.154026:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a07 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67706 expref: 39 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.157392:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c6042484700) 00010000:00010000:1.0:1788792134.157399:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788792134.157414:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a07 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67706 expref: 39 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.157442:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6141689000, rc 0) 00000100:00100000:1.0:1788792134.157553:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+38:18846:x1875683760576768:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 4067us (4413us total) trans 12884901915 rc 301/301 00000100:00100000:1.0:1788792134.157586:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00100000:0.0:1788792134.163833:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792134.163936:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760576896 00000100:00100000:1.0:1788792134.163952:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760576896 00000100:00100000:1.0:1788792134.164211:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:1.0:1788792134.164312:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617faf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+38:18846:x1875683760576896:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788792134.164475:0:22664:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788792134.164625:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617faf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+38:18846:x1875683760576896:12345-192.168.201.20@tcp:53:lhsmtool_posix.0 Request processed in 403us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792134.164634:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:0.0:1788792134.171931:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792134.172565:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760577152 00000100:00100000:2.0:1788792134.172580:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760577152 00000100:00100000:2.0:1788792134.172659:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:2.0:1788792134.172672:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617fafbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+38:18846:x1875683760577152:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788792134.172701:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792134.172731:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67e00/0x4d37c11031f36a1c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c6770d expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788792134.176616:0:22665:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =60 00000004:00080000:2.0:1788792134.176632:0:22665:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+60 in llog 00000004:00080000:2.0:1788792134.176657:0:22665:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788792134.176933:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66200/0x4d37c11031f36a23 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.176978:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66200/0x4d37c11031f36a23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.176992:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66200/0x4d37c11031f36a23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.177090:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67e00/0x4d37c11031f36a1c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6770d expref: 41 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.177112:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66200/0x4d37c11031f36a23 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6770d expref: 40 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.177122:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c6170db3700) 00010000:00010000:2.0:1788792134.177125:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788792134.177130:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6174e66200, rc 0) 00000100:00100000:2.0:1788792134.178849:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617fafbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+40:18846:x1875683760577152:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 6164us (6962us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788792134.178863:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:1.0:1788792134.200992:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792134.201329:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760577408 00000100:00100000:3.0:1788792134.201420:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760577408 00000100:00100000:3.0:1788792134.201547:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:3.0:1788792134.201561:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+40:18846:x1875683760577408:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788792134.201642:0:24649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788792134.201693:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66200/0x4d37c11031f36a23 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6770d expref: 40 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.201722:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c6170db3700) 00010000:00010000:3.0:1788792134.201736:0:24649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788792134.201771:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36a31 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.201790:0:24649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36a31 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.201803:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36a31 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.201822:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a38 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x83898567 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.201829:0:24649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a38 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x83898567 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.201835:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a38 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x83898567 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.202273:0:24649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36a31 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.202283:0:24649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36a31 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.202299:0:24649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36a31 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.202306:0:24649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413aba00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:3.0:1788792134.202311:0:24649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36a31 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.202319:0:24649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36a31 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.202328:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c6042484200) 00010000:00010000:3.0:1788792134.202331:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788792134.202336:0:24649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36a31 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.202343:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aba00/0x4d37c11031f36a31 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.202669:0:24649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a38 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x83898567 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.202675:0:24649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a38 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x83898567 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.202692:0:24649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a38 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x83898567 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.202698:0:24649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6175ee8e00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:3.0:1788792134.202701:0:24649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a38 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x83898567 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.202720:0:24649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a38 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x83898567 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.202728:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x83898567 (ffff8c6144cc3100) 00010000:00010000:3.0:1788792134.202730:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788792134.202733:0:24649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a38 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x83898567 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.202738:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a38 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x83898567 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792134.202857:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+39:18846:x1875683760577408:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 1295us (1880us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788792134.202865:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:0.0:1788792134.213592:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792134.214105:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760577536 00000100:00100000:1.0:1788792134.214121:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760577536 00000100:00100000:1.0:1788792134.214325:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:1.0:1788792134.214341:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617fafb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+39:18846:x1875683760577536:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788792134.214575:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788792134.214606:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a3f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67714 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.214656:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f36a46 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.214673:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f36a46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.214700:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f36a46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.214837:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a3f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67714 expref: 41 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.214859:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689c00/0x4d37c11031f36a46 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67714 expref: 40 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.214869:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c6042484400) 00010000:00010000:1.0:1788792134.214932:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788792134.214936:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6141689c00, rc 0) 00000100:00100000:1.0:1788792134.215023:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617fafb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+40:18846:x1875683760577536:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 685us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792134.215031:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:0.0:1788792134.221717:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792134.222050:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760577792 00000100:00100000:3.0:1788792134.222067:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760577792 00000100:00100000:3.0:1788792134.222172:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:3.0:1788792134.222187:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617faf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+40:18846:x1875683760577792:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788792134.222323:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a4d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.222342:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a4d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.222356:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a4d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788792134.222577:0:22664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1788792134.222588:0:22664:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777239715003ns, next at 778239711968ns, rc = 0 00000004:00010000:3.0:1788792134.222687:0:22664:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000bebe0a33 reply state 00000000ca398798 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a4d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.222703:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a4d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.222711:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c6042484400) 00010000:00010000:3.0:1788792134.222714:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788792134.222718:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788792134.222853:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617faf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+42:18846:x1875683760577792:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 668us (1151us total) trans 12884901917 rc 0/0 00000100:00100000:3.0:1788792134.222861:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:3.0:1788792134.226792:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792134.227827:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760577920 00000100:00100000:2.0:1788792134.227842:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760577920 00000100:00100000:2.0:1788792134.227953:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:2.0:1788792134.227965:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+42:18846:x1875683760577920:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788792134.227992:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792134.228017:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67600/0x4d37c11031f36a54 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c6771b expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.228104:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67600/0x4d37c11031f36a54 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6771b expref: 43 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.228138:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67600/0x4d37c11031f36a54 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6771b expref: 43 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.228160:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c6042484400) 00010000:00010000:2.0:1788792134.228163:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788792134.228168:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6174e67600, rc 0) 00000100:00100000:2.0:1788792134.228261:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+43:18846:x1875683760577920:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 296us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792134.228269:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:0.0:1788792134.233588:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792134.233719:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760578048 00000100:00100000:3.0:1788792134.233737:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760578048 00000100:00100000:3.0:1788792134.233842:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:3.0:1788792134.233857:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617faf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2420:x1875683760578048:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788792134.234380:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788792134.235646:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617faf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:2420:x1875683760578048:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 1376us (1657us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1788792134.235661:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:1.0:1788792134.250504:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792134.250615:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760578304 00000100:00100000:0.0:1788792134.250625:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760578304 00000100:00100000:0.0:1788792134.250683:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:0.0:1788792134.250695:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+43:18846:x1875683760578304:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788792134.251504:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+44:18846:x1875683760578304:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 804us (1007us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1788792134.251514:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:1.0:1788792134.260802:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792134.264539:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760578560 00000100:00100000:3.0:1788792134.264560:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760578560 00000100:00100000:0.0:1788792134.267169:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:0.0:1788792134.267185:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+44:18846:x1875683760578560:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788792134.267703:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+44:18846:x1875683760578560:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 520us (6913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792134.267712:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:2.0:1788792134.271550:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792134.272341:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760578688 00000100:00100000:3.0:1788792134.272367:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760578688 00000100:00100000:3.0:1788792134.272441:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:3.0:1788792134.272453:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+44:18846:x1875683760578688:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788792134.272481:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792134.272508:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8200/0x4d37c11031f36a5b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67722 expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.272616:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee9a00/0x4d37c11031f36a62 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.272632:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee9a00/0x4d37c11031f36a62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.272643:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee9a00/0x4d37c11031f36a62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788792134.272705:0:22665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788792134.272728:0:22665:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee9a00/0x4d37c11031f36a62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.272756:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8200/0x4d37c11031f36a5b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67722 expref: 46 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.272773:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee9a00/0x4d37c11031f36a62 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67722 expref: 45 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.272782:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c6042484400) 00010000:00010000:3.0:1788792134.272785:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788792134.272788:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6175ee9a00, rc 0) 00000100:00100000:3.0:1788792134.272861:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+45:18846:x1875683760578688:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 411us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792134.272868:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:2.0:1788792134.280369:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792134.280487:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760578816 00000100:00100000:3.0:1788792134.280499:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760578816 00000100:00100000:3.0:1788792134.280567:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:3.0:1788792134.280591:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:2419:x1875683760578816:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788792134.280619:0:24170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792134.280646:0:24170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a69 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67729 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788792134.280679:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ecd46, blocks: 0x0 00010000:00010000:3.0:1788792134.280709:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=777s v=(0 0) 00010000:00010000:3.0:1788792134.280715:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792134.280726:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67729 expref: 7 pid: 24170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.280747:0:24170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67729 expref: 7 pid: 24170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.280764:0:24170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6175ee9e00, rc 0) 00000100:00100000:3.0:1788792134.280843:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:2419:x1875683760578816:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 252us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792134.280849:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:1.0:1788792134.292808:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792134.292963:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760579072 00000100:00100000:0.0:1788792134.292977:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760579072 00000100:00100000:0.0:1788792134.293055:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:0.0:1788792134.293066:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+45:18846:x1875683760579072:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788792134.293392:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+45:18846:x1875683760579072:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 326us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792134.293400:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:2.0:1788792134.307126:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792134.307419:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760579200 00000100:00100000:3.0:1788792134.307432:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760579200 00000100:00100000:3.0:1788792134.307515:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:3.0:1788792134.307528:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+45:18846:x1875683760579200:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788792134.312485:0:22644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:0.0:1788792134.312507:0:22644:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788792134.312587:0:22644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1788792134.312795:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa600/0x4d37c11031f36871 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.312810:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa600/0x4d37c11031f36871 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.312828:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa600/0x4d37c11031f36871 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.312835:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413aa600 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:3.0:1788792134.312840:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa600/0x4d37c11031f36871 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.312850:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa600/0x4d37c11031f36871 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.312869:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c6042484200) 00010000:00010000:3.0:1788792134.312903:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788792134.312908:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa600/0x4d37c11031f36871 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.312915:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa600/0x4d37c11031f36871 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792134.313105:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+20:18846:x1875683760579200:12345-192.168.201.20@tcp:44:lhsmtool_posix.0 Request processed in 5573us (5995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792134.313115:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:1.0:1788792134.313367:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788792134.313385:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617b8e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785854592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788792134.313616:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792134.313718:0:24651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785854592 00000100:00100000:3.0:1788792134.313729:0:24651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785854592 00000100:00100000:3.0:1788792134.313796:0:24651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788792134.313806:0:24651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617b8e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785854592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788792134.313988:0:24651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788792134.313992:0:24651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788792134.313994:0:24651:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788792134.313996:0:24651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788792134 -> 1788792134 00002000:00010000:3.0:1788792134.314009:0:24651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788792134.314046:0:24651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617b8e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875683785854592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 242us (430us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788792134.314053:0:24651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788792134.314738:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788792134.314789:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c617b8e9500/2, rc 0, transno 12884901892 00000100:00100000:1.0:1788792134.314798:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617b8e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785854592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788792134.318766:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792134.318915:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760579328 00000100:00100000:3.0:1788792134.318932:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760579328 00000100:00100000:3.0:1788792134.319003:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:3.0:1788792134.319016:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60444f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:2420:x1875683760579328:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788792134.319182:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60444f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:2420:x1875683760579328:12345-192.168.201.20@tcp:16:lhsmtool_posix.0 Request processed in 167us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792134.319191:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00010000:00010000:2.0:1788792134.320726:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c800/0x4d37c11031f3681d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320744:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c800/0x4d37c11031f3681d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320752:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c800/0x4d37c11031f3681d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320758:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086c800 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792134.320762:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c800/0x4d37c11031f3681d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320769:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c800/0x4d37c11031f3681d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320807:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8c61435aff00) 00010000:00010000:2.0:1788792134.320810:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792134.320814:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c800/0x4d37c11031f3681d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320820:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086c800/0x4d37c11031f3681d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320843:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36824 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320847:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36824 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320853:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36824 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320857:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141688e00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792134.320860:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36824 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320864:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36824 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320892:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c6042484200) 00010000:00010000:2.0:1788792134.320895:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792134.320898:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36824 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320903:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36824 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320929:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aac00/0x4d37c11031f368da lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320934:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aac00/0x4d37c11031f368da lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320940:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aac00/0x4d37c11031f368da lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320946:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413aac00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792134.320948:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aac00/0x4d37c11031f368da lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320954:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aac00/0x4d37c11031f368da lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320962:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8c6144cc3f00) 00010000:00010000:2.0:1788792134.320965:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792134.320967:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aac00/0x4d37c11031f368da lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320972:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aac00/0x4d37c11031f368da lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320987:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f3695f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320992:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f3695f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.320998:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f3695f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321008:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086d800 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792134.321012:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f3695f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321018:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f3695f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321026:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:2.0:1788792134.321028:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792134.321032:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f3695f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321046:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f3695f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321057:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36982 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321063:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36982 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321070:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36982 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321074:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413aa000 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792134.321076:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36982 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321081:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36982 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321102:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:2.0:1788792134.321104:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792134.321107:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36982 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321113:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa000/0x4d37c11031f36982 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321125:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f369c8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321130:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f369c8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321135:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f369c8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321140:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086d400 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792134.321143:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f369c8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321149:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f369c8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321155:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:2.0:1788792134.321158:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788792134.321160:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f369c8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321166:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d400/0x4d37c11031f369c8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321187:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a4d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321192:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a4d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321197:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a4d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321202:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6175ee8e00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:2.0:1788792134.321312:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a4d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321320:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a4d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321329:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c6042484400) 00010000:00010000:2.0:1788792134.321331:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788792134.321334:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a4d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.321338:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee8e00/0x4d37c11031f36a4d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792134.324706:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792134.324868:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760579584 00000100:00100000:1.0:1788792134.324912:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760579584 00000100:00100000:1.0:1788792134.324985:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:1.0:1788792134.324998:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617fafa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+14:18846:x1875683760579584:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788792134.325104:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788792134.325142:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee9a00/0x4d37c11031f36a62 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67722 expref: 14 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.325164:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c6042484400) 00010000:00010000:1.0:1788792134.325169:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788792134.325387:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a70 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.325411:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a70 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.325422:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a70 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788792134.325567:0:22664:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000002af2f83 reply state 0000000058a4ed43 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a70 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.325581:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689000/0x4d37c11031f36a70 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.325588:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c6042484400) 00010000:00010000:1.0:1788792134.325590:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788792134.325594:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788792134.325838:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617fafa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+15:18846:x1875683760579584:12345-192.168.201.20@tcp:36:lhsmtool_posix.0 Request processed in 842us (1154us total) trans 12884901919 rc 0/0 00000100:00100000:1.0:1788792134.325847:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:0.0:1788792134.329168:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792134.329526:0:24651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760579712 00000100:00100000:3.0:1788792134.329539:0:24651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760579712 00000100:00100000:3.0:1788792134.329607:0:24651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:3.0:1788792134.329618:0:24651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617faf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:18846:x1875683760579712:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788792134.329638:0:24651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792134.329655:0:24651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dee30749/0x4d37c11031f36a77 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67730 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.329700:0:24651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a69 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67729 expref: 8 pid: 24170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.329709:0:24651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792134.329714:0:24651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792134.329719:0:24651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee30749/0x4d37c11031f36a77 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67730 expref: 8 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.329772:0:24651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67729 expref: 8 pid: 24170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.329787:0:24651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67729 expref: 8 pid: 24170 timeout: 877 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792134.329802:0:24651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24651:1875683785854720:192.168.201.20@tcp:104: 00000100:00100000:3.0:1788792134.329912:0:24651:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c614714b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788792134.333328:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792134.333742:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760579840 00000100:00100000:1.0:1788792134.333757:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760579840 00010000:00010000:1.0:1788792134.333812:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a69 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67729 expref: 9 pid: 24170 timeout: 877 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792134.333896:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:1.0:1788792134.333911:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+9:2420:x1875683760579840:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788792134.333929:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788792134.333956:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a69 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67729 expref: 9 pid: 24170 timeout: 877 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.333972:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67729 expref: 9 pid: 24170 timeout: 877 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.334003:0:22650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788792134.334009:0:22650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788792134.334016:0:22650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dee30749/0x4d37c11031f36a77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67730 expref: 9 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.334028:0:22650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee30749/0x4d37c11031f36a77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67730 expref: 9 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.334307:0:24651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a69 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67729 expref: 9 pid: 24170 timeout: 877 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792134.334328:0:24651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24651:1875683785854720:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788792134.334362:0:24651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dee30749/0x4d37c11031f36a77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67730 expref: 8 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.334375:0:24651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6175ee8200, rc 0) 00000100:00100000:3.0:1788792134.334461:0:24651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617faf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+8:18846:x1875683760579712:12345-192.168.201.20@tcp:101:lhsmtool_posix.0 Request processed in 4843us (5302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792134.334469:0:24651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00010000:00010000:1.0:1788792134.335970:0:22650:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dee30749/0x4d37c11031f36a77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67730 expref: 7 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792134.335989:0:22650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60444f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22650:1875683785854848:192.168.201.20@tcp:105: 00000100:00100000:1.0:1788792134.336077:0:22650:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c61809f2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788792134.340519:0:22650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60444f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22650:1875683785854848:192.168.201.20@tcp:105: 00010000:00010000:1.0:1788792134.340562:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788792134.340728:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:2420:x1875683760579840:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 6817us (7417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792134.340741:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:2.0:1788792134.340996:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792134.341612:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760579968 00000100:00100000:3.0:1788792134.341621:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760579968 00000100:00100000:3.0:1788792134.341670:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:3.0:1788792134.341687:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:2419:x1875683760579968:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788792134.341850:0:24170:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788792134.341854:0:24170:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788792133 00002000:00010000:3.0:1788792134.341857:0:24170:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788792131 00002000:00010000:3.0:1788792134.341859:0:24170:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788792134 -> 1788792133 00002000:00010000:3.0:1788792134.341861:0:24170:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788792134.341925:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+8:2419:x1875683760579968:12345-192.168.201.20@tcp:2:lhsmtool_posix.0 Request processed in 246us (928us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788792134.341932:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:2.0:1788792134.346023:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792134.346215:0:24651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760580096 00000100:00100000:3.0:1788792134.346227:0:24651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760580096 00000100:00100000:3.0:1788792134.346311:0:24651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:3.0:1788792134.346322:0:24651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+8:2419:x1875683760580096:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788792134.346370:0:24651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a7e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.346390:0:24651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dee30749/0x4d37c11031f36a77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67730 expref: 8 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.346557:0:24651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792134.346563:0:24651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788792134.346568:0:24651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a7e lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.346617:0:24651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dee30749/0x4d37c11031f36a77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67730 expref: 8 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.346655:0:24651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dee30749/0x4d37c11031f36a77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67730 expref: 8 pid: 24651 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792134.346671:0:24651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24651:1875683785854976:192.168.201.20@tcp:104: 00000100:00100000:3.0:1788792134.346832:0:24651:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c614714b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788792134.350664:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792134.350956:0:24651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24651:1875683785854976:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788792134.350992:0:24651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a7e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792134.351624:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760580224 00000100:00100000:0.0:1788792134.351636:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760580224 00010000:00010000:1.0:1788792134.351854:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dee30749/0x4d37c11031f36a77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67730 expref: 9 pid: 24651 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792134.351972:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:1.0:1788792134.351984:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+9:2419:x1875683760580224:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788792134.352001:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788792134.352027:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dee30749/0x4d37c11031f36a77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67730 expref: 9 pid: 24651 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.352043:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dee30749/0x4d37c11031f36a77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67730 expref: 9 pid: 24651 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.352067:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee30749/0x4d37c11031f36a77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67730 expref: 9 pid: 24651 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.352087:0:22649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788792134.352092:0:22649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788792134.352098:0:22649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a7e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.352110:0:22649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a7e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.352161:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788792134.352250:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+8:2419:x1875683760580224:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 268us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792134.352258:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00010000:00010000:3.0:1788792134.352316:0:24651:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a7e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.352325:0:24651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a7e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.352347:0:24651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a7e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.352356:0:24651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a7e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.352364:0:24651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.352382:0:24651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6175ee9e00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788792134.352386:0:24651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.352403:0:24651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.352415:0:24651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a7e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.352421:0:24651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36a7e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788792134.352470:0:24651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:2419:x1875683760580096:12345-192.168.201.20@tcp:1:lhsmtool_posix.0 Request processed in 6150us (6459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792134.352478:0:24651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:3.0:1788792134.355336:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792134.355648:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760580480 00000100:00100000:0.0:1788792134.355660:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760580480 00000100:00100000:0.0:1788792134.355750:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:0.0:1788792134.355762:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+15:18846:x1875683760580480:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788792134.355859:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.355908:0:24649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f36958 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ce expref: 15 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.355919:0:24649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.355963:0:24649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f36958 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ce expref: 15 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.355979:0:24649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f36958 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ce expref: 15 pid: 24649 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792134.355997:0:24649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617faf9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24649:1875683785855104:192.168.201.20@tcp:104: 00000100:00100000:0.0:1788792134.356099:0:24649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6150914900 going to sleep for 11 seconds 00000100:00100000:3.0:1788792134.358736:0:24649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617faf9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24649:1875683785855104:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788792134.358770:0:24649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792134.360434:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792134.360946:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760580608 00000100:00100000:2.0:1788792134.360958:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760580608 00010000:00010000:2.0:1788792134.361028:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f36958 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ce expref: 16 pid: 24649 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792134.361184:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1788792134.361377:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617faf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+16:2420:x1875683760580608:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788792134.361461:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788792134.361471:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f36958 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ce expref: 16 pid: 24649 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.361488:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f36958 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ce expref: 16 pid: 24649 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.361516:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086da00/0x4d37c11031f36958 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ce expref: 16 pid: 24649 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.361536:0:22651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:2.0:1788792134.361541:0:22651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f369eb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ff expref: 15 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.361552:0:22651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.361559:0:22651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.361568:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.361604:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788792134.361674:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617faf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+15:2420:x1875683760580608:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 469us (1249us total) trans 0 rc 0/0 00010000:00010000:0.0:1788792134.361777:0:24649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.361786:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.362063:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.362076:0:24649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67600/0x4d37c11031f36a54 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6771b expref: 16 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.362084:0:24649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.362122:0:24649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67600/0x4d37c11031f36a54 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6771b expref: 16 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.362138:0:24649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67600/0x4d37c11031f36a54 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6771b expref: 16 pid: 22665 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792134.362153:0:24649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617f9b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24649:1875683785855232:192.168.201.20@tcp:104: 00000100:00100000:0.0:1788792134.362787:0:24649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6150914c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788792134.365911:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:1.0:1788792134.368037:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792134.368245:0:24649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617f9b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24649:1875683785855232:192.168.201.20@tcp:104: 00010000:00010000:0.0:1788792134.368283:0:24649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792134.368537:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760580736 00000100:00100000:2.0:1788792134.368547:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760580736 00010000:00010000:2.0:1788792134.368596:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67600/0x4d37c11031f36a54 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6771b expref: 16 pid: 22665 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788792134.368698:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:2.0:1788792134.368711:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61812d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+16:2419:x1875683760580736:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788792134.368732:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788792134.368742:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67600/0x4d37c11031f36a54 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6771b expref: 16 pid: 22665 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.368756:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67600/0x4d37c11031f36a54 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6771b expref: 16 pid: 22665 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.368780:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67600/0x4d37c11031f36a54 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6771b expref: 16 pid: 22665 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.368798:0:22650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c6042484400) 00010000:00010000:2.0:1788792134.368803:0:22650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.368815:0:22650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.368823:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.368987:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788792134.369070:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61812d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+15:2419:x1875683760580736:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 362us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792134.369079:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00010000:00010000:0.0:1788792134.371642:0:24649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.371661:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788792134.372351:0:24649:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:0.0:1788792134.372585:0:24649:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:0.0:1788792134.372619:0:24649:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:0.0:1788792134.372789:0:24649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617f9b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24649:1875683785855360:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788792134.373022:0:24649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792134.373353:0:24649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6150914240 going to sleep for 11 seconds 00000100:00100000:2.0:1788792134.373469:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785855360 00000100:00100000:2.0:1788792134.373481:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785855360 00000100:00100000:2.0:1788792134.373605:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788792134.373618:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c617f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:24649:x1875683785855360:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788792134.373740:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c617f9b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:24649:x1875683785855360:12345-0@lo:1000:mdt00_003.0 Request processed in 124us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792134.373746:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788792134.373822:0:24649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617f9b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24649:1875683785855360:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788792134.374077:0:24649:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:0.0:1788792134.374147:0:24649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c617f9b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24649:1875683785855488:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788792134.374188:0:24649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792134.374906:0:24649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6150914900 going to sleep for 11 seconds 00000100:00100000:3.0:1788792134.375148:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785855488 00000100:00100000:3.0:1788792134.375160:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785855488 00000100:00100000:3.0:1788792134.375239:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788792134.375250:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:24649:x1875683785855488:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788792134.375503:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:24649:x1875683785855488:12345-0@lo:1000:mdt00_003.0 Request processed in 255us (1314us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1788792134.375512:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788792134.376002:0:24649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c617f9b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24649:1875683785855488:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788792134.376065:0:24649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376077:0:24649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376085:0:24649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376092:0:24649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086cc00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:0.0:1788792134.376097:0:24649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376105:0:24649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376126:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c6042484400) 00010000:00010000:0.0:1788792134.376130:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788792134.376147:0:24649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376154:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086cc00/0x4d37c11031f36a8c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376194:0:24649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f369e4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376213:0:24649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f369e4 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376220:0:24649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f369e4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376225:0:24649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c61413ab600 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:0.0:1788792134.376445:0:24649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f369e4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376453:0:24649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f369e4 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376462:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:0.0:1788792134.376465:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788792134.376473:0:24649:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f369eb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ff expref: 18 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376484:0:24649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f369eb lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ff expref: 18 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376495:0:24649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f369eb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ff expref: 18 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.376585:0:24649:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413aa200/0x4d37c11031f369eb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c676ff expref: 18 pid: 24649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792134.376601:0:24649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043d15180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24649:1875683785855616:192.168.201.20@tcp:105: 00000100:00100000:0.0:1788792134.376826:0:24649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c6150914900 going to sleep for 11 seconds 00000100:00100000:0.0:1788792134.380434:0:24649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043d15180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24649:1875683785855616:192.168.201.20@tcp:105: 00010000:00010000:0.0:1788792134.380470:0:24649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f369e4 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380482:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c61413ab600/0x4d37c11031f369e4 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380517:0:24649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f36a93 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380530:0:24649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f36a93 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380540:0:24649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f36a93 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380550:0:24649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f36a93 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380556:0:24649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f36a93 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380562:0:24649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f36a93 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380586:0:24649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086d800 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:0.0:1788792134.380590:0:24649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f36a93 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380598:0:24649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f36a93 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380611:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:0.0:1788792134.380614:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788792134.380617:0:24649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f36a93 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380623:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d800/0x4d37c11031f36a93 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380634:0:24649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380640:0:24649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380645:0:24649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380650:0:24649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086de00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:0.0:1788792134.380653:0:24649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380659:0:24649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380690:0:24649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:0.0:1788792134.380692:0:24649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788792134.380695:0:24649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.380701:0:24649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086de00/0x4d37c11031f36a85 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788792134.380902:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+18:18846:x1875683760580480:12345-192.168.201.20@tcp:57:lhsmtool_posix.0 Request processed in 25140us (25575us total) trans 12884901924 rc 0/0 00000100:00100000:0.0:1788792134.380913:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 70 00000020:00080000:0.0:1788792134.380920:0:24649:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788792134.384000:0:22700:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788792134.384010:0:22700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788792134.384035:0:22700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788792134.384041:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788792134.384441:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792134.384477:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760580864 00000100:00100000:0.0:1788792134.384486:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760580864 00000100:00100000:0.0:1788792134.384539:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:0.0:1788792134.384549:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+18:18845:x1875683760580864:12345-192.168.201.20@tcp:49:bash.0 00000100:00100000:0.0:1788792134.384827:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+18:18845:x1875683760580864:12345-192.168.201.20@tcp:49:bash.0 Request processed in 278us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792134.384836:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:0.0:1788792134.384902:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792134.384921:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760581120 00000100:00100000:0.0:1788792134.384925:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760581120 00000100:00100000:0.0:1788792134.384946:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:0.0:1788792134.384953:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+18:18846:x1875683760581120:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788792134.385594:0:22667:0:(mdd_object.c:4131:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788792134.385653:0:22667:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:0.0:1788792134.385862:0:22667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36a9a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.385920:0:22667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36a9a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.385934:0:22667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36a9a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.385943:0:22667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36a9a lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.385950:0:22667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36a9a lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.385956:0:22667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36a9a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788792134.385975:0:22667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788792134.386067:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+20:18846:x1875683760581120:12345-192.168.201.20@tcp:35:lhsmtool_posix.0 Request processed in 1109us (1159us total) trans 12884901926 rc 0/0 00000100:00100000:0.0:1788792134.386075:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000020:00080000:0.0:1788792134.386079:0:22667:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788792134.386291:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788792134.386301:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36a9a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.386310:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c615086d000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788792134.386315:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36a9a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.386325:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36a9a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.386341:0:22652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8c6042484400) 00010000:00010000:2.0:1788792134.386344:0:22652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788792134.386350:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36a9a lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.386356:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c615086d000/0x4d37c11031f36a9a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.386382:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792134.386383:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792134.386385:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788792134.391647:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792134.391797:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760581248 00000100:00100000:3.0:1788792134.391808:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760581248 00000100:00100000:3.0:1788792134.391979:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:3.0:1788792134.391991:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60444f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+7:18845:x1875683760581248:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1788792134.392012:0:24170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792134.392037:0:24170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36aa1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67737 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788792134.392070:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9ecd45, atime: 0x6a9ecd43, ctime: 0x6a9ecd45, blocks: 0x0 00010000:00010000:3.0:1788792134.392099:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=777s v=(0 0) 00010000:00010000:3.0:1788792134.392105:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788792134.392117:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36aa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67737 expref: 8 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.392135:0:24170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000135b78d6/0x4d37c11031f36aa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67737 expref: 8 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.392150:0:24170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6175ee9e00, rc 0) 00000100:00100000:3.0:1788792134.392236:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60444f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+8:18845:x1875683760581248:12345-192.168.201.20@tcp:101:bash.0 Request processed in 239us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792134.392260:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:0.0:1788792134.395971:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792134.396051:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760581376 00000100:00100000:2.0:1788792134.396063:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760581376 00000100:00100000:2.0:1788792134.396172:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:2.0:1788792134.396184:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+20:18845:x1875683760581376:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1788792134.396208:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788792134.396240:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67600/0x4d37c11031f36aa8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c6773e expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.396281:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66800/0x4d37c11031f36aaf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.396297:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66800/0x4d37c11031f36aaf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.396309:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66800/0x4d37c11031f36aaf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.396459:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e67600/0x4d37c11031f36aa8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6773e expref: 22 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.396477:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6174e66800/0x4d37c11031f36aaf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c6773e expref: 21 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788792134.396486:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:2.0:1788792134.396489:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788792134.396499:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6174e66800, rc 0) 00000100:00100000:2.0:1788792134.396565:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+21:18845:x1875683760581376:12345-192.168.201.20@tcp:101:bash.0 Request processed in 384us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792134.396573:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:0.0:1788792134.401016:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792134.401189:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760581632 00000100:00100000:2.0:1788792134.401203:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760581632 00000100:00100000:2.0:1788792134.401278:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:2.0:1788792134.401289:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+21:18845:x1875683760581632:12345-192.168.201.20@tcp:35:bash.0 00000001:00080000:2.0:1788792134.401559:0:22667:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:2.0:1788792134.401704:0:22667:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:2.0:1788792134.401924:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+24:18845:x1875683760581632:12345-192.168.201.20@tcp:35:bash.0 Request processed in 634us (918us total) trans 12884901929 rc 0/0 00000100:00100000:2.0:1788792134.401932:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00000020:00080000:2.0:1788792134.401940:0:22667:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788792134.496693:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792134.496788:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760581888 00000100:00100000:3.0:1788792134.496799:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760581888 00000100:00100000:3.0:1788792134.496864:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:3.0:1788792134.496907:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+24:18856:x1875683760581888:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1788792134.496938:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788792134.496960:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee9c00/0x4d37c11031f36ab6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33a37a5a14c67745 expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788792134.497067:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788792134.497179:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee9c00/0x4d37c11031f36ab6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67745 expref: 26 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.497210:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c6170db3100) 00010000:00010000:3.0:1788792134.497213:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788792134.497218:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6175ee9c00/0x4d37c11031f36ab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x33a37a5a14c67745 expref: 26 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788792134.497245:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c6175ee9c00, rc 0) 00000100:00100000:3.0:1788792134.497321:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+25:18856:x1875683760581888:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 447us (648us total) trans 12884901930 rc 301/301 00000100:00100000:3.0:1788792134.497330:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:0.0:1788792134.501046:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792134.501218:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760582016 00000100:00100000:1.0:1788792134.501239:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760582016 00000100:00100000:1.0:1788792134.501329:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:1.0:1788792134.501341:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+25:18856:x1875683760582016:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:1.0:1788792134.501448:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36ac4 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501468:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36ac4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501479:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36ac4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501497:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f36acb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501505:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f36acb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501511:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f36acb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501620:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6181362200/0x4d37c11031f36ad2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501651:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c6181362200/0x4d37c11031f36ad2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501658:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c6181362200/0x4d37c11031f36ad2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788792134.501731:0:22664:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c6181362200/0x4d37c11031f36ad2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501746:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36ac4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501753:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36ac4 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501759:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36ac4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501766:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141688e00 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:1.0:1788792134.501770:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36ac4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501777:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36ac4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501791:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8c6042484200) 00010000:00010000:1.0:1788792134.501795:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788792134.501799:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36ac4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501805:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141688e00/0x4d37c11031f36ac4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501826:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f36acb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501832:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f36acb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501837:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f36acb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501840:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6141689200 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:1.0:1788792134.501842:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f36acb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501848:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f36acb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501854:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8c6042484c00) 00010000:00010000:1.0:1788792134.501856:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788792134.501859:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f36acb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501865:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6141689200/0x4d37c11031f36acb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501941:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c6181362200/0x4d37c11031f36ad2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501948:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c6181362200/0x4d37c11031f36ad2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501954:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c6181362200/0x4d37c11031f36ad2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501965:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c6181362200 already unused, calling callback (ffffffffc18934f0) 00010000:00010000:1.0:1788792134.501968:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6181362200/0x4d37c11031f36ad2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501975:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c6181362200/0x4d37c11031f36ad2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501984:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8c6144cc3000) 00010000:00010000:1.0:1788792134.501986:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788792134.501989:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c6181362200/0x4d37c11031f36ad2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788792134.501994:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c6181362200/0x4d37c11031f36ad2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788792134.502085:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+25:18856:x1875683760582016:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 744us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792134.502094:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:1.0:1788792134.506224:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792134.506375:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760582272 00000100:00100000:2.0:1788792134.506398:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760582272 00000100:00100000:2.0:1788792134.506463:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:2.0:1788792134.506473:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60444f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+25:18856:x1875683760582272:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1788792134.506753:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60444f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+26:18856:x1875683760582272:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 280us (548us total) trans 12884901931 rc 0/0 00000100:00100000:2.0:1788792134.506761:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00010000:00010000:3.0:1788792134.681957:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788792135.705032:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788792136.088832:0:25749:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:1.0:1788792136.216787:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60444f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785855872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788792136.216902:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61435cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785855744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788792136.217260:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792136.217321:0:25584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785855872 00000100:00100000:0.0:1788792136.217331:0:25584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785855872 00000100:00100000:0.0:1788792136.217400:0:25584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788792136.217412:0:25584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60444f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785855872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788792136.217464:0:25584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788792136.218937:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792136.219031:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785855744 00000100:00100000:3.0:1788792136.219038:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785855744 00000100:00100000:3.0:1788792136.219074:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788792136.219082:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875683785855744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788792136.219104:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788792136.219142:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875683785855744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792136.219146:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788792136.219207:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61435cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785855744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788792136.221787:0:25584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60444f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785855872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4364us (4514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792136.221805:0:25584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788792136.221845:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788792136.221910:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60444f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785855872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788792136.471851:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792136.471930:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792136.471963:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792136.472000:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792136.472025:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788792136.472055:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760582656 00000100:00100000:0.0:1788792136.472064:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760582656 00000100:00100000:0.0:1788792136.472119:0:24649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760583168 00000100:00100000:0.0:1788792136.472122:0:24649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760583168 00000100:00100000:0.0:1788792136.472148:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:0.0:1788792136.472159:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2419:x1875683760582656:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788792136.472419:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2419:x1875683760582656:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 262us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792136.472427:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:0.0:1788792136.472445:0:24649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:0.0:1788792136.472451:0:24649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8998039c-e054-49d5-8067-ce5c17a03855+5:2419:x1875683760583168:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788792136.472473:0:24649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8998039c-e054-49d5-8067-ce5c17a03855+5:2419:x1875683760583168:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792136.472480:0:24649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00080000:0.0:1788792136.472495:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788792136.472579:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760582912 00000100:00100000:2.0:1788792136.472584:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760582912 00000100:00100000:2.0:1788792136.472618:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760583424 00000100:00100000:2.0:1788792136.472621:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760583424 00000100:00100000:2.0:1788792136.472637:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1788792136.472643:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2419:x1875683760582912:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788792136.472684:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+5:2419:x1875683760582912:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 41us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792136.472691:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1788792136.472703:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:2.0:1788792136.472709:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8998039c-e054-49d5-8067-ce5c17a03855+5:2419:x1875683760583424:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788792136.472729:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8998039c-e054-49d5-8067-ce5c17a03855+5:2419:x1875683760583424:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792136.472736:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00080000:0.0:1788792136.472795:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788792136.472924:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760582400 00000100:00100000:1.0:1788792136.472929:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760582400 00000100:00100000:1.0:1788792136.472966:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 167 00000100:00100000:1.0:1788792136.472973:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+13:2419:x1875683760582400:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788792136.472999:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55156022-243d-49cf-9038-3cfcecfd35e3+13:2419:x1875683760582400:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792136.473012:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 167 00000100:00100000:3.0:1788792136.473977:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792136.474014:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792136.474041:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792136.474072:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788792136.474097:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760582784 00000100:00100000:3.0:1788792136.474103:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760582784 00000100:00100000:3.0:1788792136.474142:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760583296 00000100:00100000:3.0:1788792136.474145:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760583296 00000100:00100000:3.0:1788792136.474165:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:3.0:1788792136.474174:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+8:2419:x1875683760582784:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788792136.474235:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+8:2419:x1875683760582784:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 62us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792136.474242:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:3.0:1788792136.474259:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:3.0:1788792136.474265:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6151f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8998039c-e054-49d5-8067-ce5c17a03855+5:2419:x1875683760583296:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788792136.474288:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6151f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8998039c-e054-49d5-8067-ce5c17a03855+5:2419:x1875683760583296:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792136.474310:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00080000:3.0:1788792136.474329:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788792136.474747:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760582528 00000100:00100000:1.0:1788792136.474753:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760582528 00000100:00100000:1.0:1788792136.474798:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760583040 00000100:00100000:1.0:1788792136.474801:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760583040 00000100:00100000:1.0:1788792136.474823:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:1.0:1788792136.474829:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61435cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+26:2419:x1875683760582528:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788792136.474907:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61435cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+26:2419:x1875683760582528:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 43us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792136.474913:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:1.0:1788792136.474926:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:1.0:1788792136.474934:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8998039c-e054-49d5-8067-ce5c17a03855+6:2419:x1875683760583040:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788792136.474956:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8998039c-e054-49d5-8067-ce5c17a03855+6:2419:x1875683760583040:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792136.474961:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00080000:3.0:1788792136.476028:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788792136.726318:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788792136.726560:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785856128:0@lo:400:kworker.0 00000100:00100000:3.0:1788792136.726647:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792136.726689:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c614354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785856640:0@lo:400:kworker.0 00000100:00100000:3.0:1788792136.726714:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792136.726731:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c614354ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875683785857152:0@lo:400:kworker.0 00000100:00100000:3.0:1788792136.726755:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792136.726779:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788792136.727006:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785856256:0@lo:400:kworker.0 00000100:00100000:3.0:1788792136.727034:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792136.727053:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c614354f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875683785856768:0@lo:400:kworker.0 00000100:00100000:3.0:1788792136.727076:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792136.727090:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60427d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875683785857280:0@lo:400:kworker.0 00000100:00100000:3.0:1788792136.727108:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792136.727143:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785856128 00000100:00100000:3.0:1788792136.727150:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785856128 00000100:00100000:3.0:1788792136.727208:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788792136.727217:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785856128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792136.727271:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785856128:12345-0@lo:400:kworker.0 Request processed in 55us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792136.727278:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788792136.727303:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785856640 00000100:00100000:3.0:1788792136.727307:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785856640 00000100:00100000:3.0:1788792136.727353:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785856256 00000100:00100000:3.0:1788792136.727357:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785856256 00000100:00100000:3.0:1788792136.727377:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788792136.727384:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785856640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792136.727417:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785856640:12345-0@lo:400:kworker.0 Request processed in 33us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792136.727423:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788792136.727435:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788792136.727441:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785856256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788792136.727467:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875683785856256:12345-0@lo:400:kworker.0 Request processed in 27us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792136.727472:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788792136.727509:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788792136.727647:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785857152 00000100:00100000:2.0:1788792136.727651:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785857152 00000100:00100000:2.0:1788792136.727688:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785856768 00000100:00100000:2.0:1788792136.727691:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785856768 00000100:00100000:2.0:1788792136.727701:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785857280 00000100:00100000:2.0:1788792136.727703:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785857280 00000100:00100000:2.0:1788792136.727719:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788792136.727725:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875683785857152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792136.727767:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875683785857152:12345-0@lo:400:kworker.0 Request processed in 42us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792136.727773:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788792136.727797:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788792136.727804:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875683785856768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792136.727832:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875683785856768:12345-0@lo:400:kworker.0 Request processed in 28us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792136.727838:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788792136.727849:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788792136.727863:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875683785857280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792136.727910:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875683785857280:12345-0@lo:400:kworker.0 Request processed in 48us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792136.727917:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788792136.727932:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788792136.727935:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788792136.728135:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a140336d-9a80-41e1-97b0-93600c05b204:3642:1875683785856000:0@lo:400:kworker.0 00000100:00100000:0.0:1788792136.728173:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792136.728220:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c614354c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785856512:0@lo:400:kworker.0 00000100:00100000:0.0:1788792136.728244:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792136.728260:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c614354c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875683785857024:0@lo:400:kworker.0 00000100:00100000:0.0:1788792136.728281:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792136.728305:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788792136.728312:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875683785856384:0@lo:400:kworker.0 00000100:00100000:0.0:1788792136.728333:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792136.728344:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c614354ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875683785856896:0@lo:400:kworker.0 00000100:00100000:0.0:1788792136.728362:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792136.728387:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785856000 00000100:00100000:0.0:1788792136.728393:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785856000 00000100:00100000:0.0:1788792136.728432:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788792136.728439:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6147af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+24:3642:x1875683785856000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792136.728446:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785857024 00000100:00100000:2.0:1788792136.728450:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785857024 00000100:00100000:2.0:1788792136.728472:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785856384 00000100:00100000:0.0:1788792136.728473:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6147af0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a140336d-9a80-41e1-97b0-93600c05b204+24:3642:x1875683785856000:12345-0@lo:400:kworker.0 Request processed in 34us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792136.728474:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785856384 00000100:00100000:0.0:1788792136.728479:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788792136.728483:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785856896 00000100:00100000:2.0:1788792136.728484:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785856896 00000100:00100000:2.0:1788792136.728495:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788792136.728500:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875683785857024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788792136.728518:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a140336d-9a80-41e1-97b0-93600c05b204:3642:1875683785856000:0@lo:400:kworker.0 00000100:00100000:2.0:1788792136.728526:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875683785857024:12345-0@lo:400:kworker.0 Request processed in 26us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792136.728532:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788792136.728543:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788792136.728549:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875683785856384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788792136.728572:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875683785856384:12345-0@lo:400:kworker.0 Request processed in 24us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792136.728577:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788792136.728587:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788792136.728593:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875683785856896:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788792136.728614:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c614354c380 x1875683785857024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788792136.728616:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875683785856896:12345-0@lo:400:kworker.0 Request processed in 24us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792136.728622:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788792136.728626:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c614354c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875683785857024:0@lo:400:kworker.0 00000100:00080000:2.0:1788792136.728643:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788792136.728646:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788792136.728715:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875683785856384:0@lo:400:kworker.0 00000100:00100000:0.0:1788792136.728725:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c614354ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875683785856896:0@lo:400:kworker.0 00000100:00100000:1.0:1788792136.729095:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c60444f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785857408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788792136.729127:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788792136.729162:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785856512 00000100:00100000:1.0:1788792136.729166:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785856512 00000100:00100000:1.0:1788792136.729214:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788792136.729222:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c61608c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785856512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788792136.729259:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c61608c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875683785856512:12345-0@lo:400:kworker.0 Request processed in 38us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792136.729266:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788792136.729286:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785857408 00000100:00100000:1.0:1788792136.729297:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785857408 00000100:00100000:1.0:1788792136.729323:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788792136.729330:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60444f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785857408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788792136.729352:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788792136.729727:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60444f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875683785857408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 397us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788792136.729735:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788792136.729782:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60444f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875683785857408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788792136.729966:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788792136.729974:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785857536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788792136.730002:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792136.730099:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c614354c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875683785856512:0@lo:400:kworker.0 00000100:00100000:3.0:1788792136.730916:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785856256:0@lo:400:kworker.0 00000100:00100000:3.0:1788792136.730929:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c614354f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875683785856768:0@lo:400:kworker.0 00010000:00080000:3.0:1788792136.730945:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c60427d1f80 x1875683785857280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788792152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788792136.730955:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c60427d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875683785857280:0@lo:400:kworker.0 00000100:00100000:3.0:1788792136.730966:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875683785856128:0@lo:400:kworker.0 00000100:00100000:3.0:1788792136.730974:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c614354dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785856640:0@lo:400:kworker.0 00000100:00100000:3.0:1788792136.730984:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c614354ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875683785857152:0@lo:400:kworker.0 00000100:00100000:2.0:1788792136.735964:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785857536 00000100:00100000:2.0:1788792136.735992:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785857536 00000100:00100000:2.0:1788792136.736092:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788792136.736107:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60444f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785857536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788792136.736144:0:24174:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788792136.736284:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60444f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875683785857536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 179us (6280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788792136.736292:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788792136.736550:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875683785857536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788792137.239739:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788792137.239793:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c61412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785857664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788792137.239904:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788792137.239966:0:23405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785857664 00000100:00100000:3.0:1788792137.239976:0:23405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785857664 00000100:00100000:3.0:1788792137.240032:0:23405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788792137.240043:0:23405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60427d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785857664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788792137.240090:0:23405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788792137.240148:0:23405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60427d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875683785857664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788792137.240156:0:23405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788792137.240221:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c61412af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875683785857664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788792137.240732:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788792137.240746:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c6043e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785857792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788792137.240796:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788792137.244509:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683785857792 00000100:00100000:0.0:1788792137.244532:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683785857792 00000100:00100000:0.0:1788792137.244630:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788792137.244643:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c60444f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785857792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788792137.244696:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788792137.244822:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c60444f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875683785857792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 181us (4024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792137.244829:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788792137.246942:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c6043e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875683785857792:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788792137.494087:0:22700:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788792137.494100:0:22700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788792137.494119:0:22700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788792137.494127:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788792137.503151:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788792137.503215:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788792137.503332:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760583552 00000100:00100000:1.0:1788792137.503344:0:24175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760583552 00002000:00100000:1.0:1788792137.503403:0:24175:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff8c6043c97800 x1875683760583552/t0(0) o4->f7fc150c-125b-4591-9e6f-98bd2b6bdc11@192.168.201.20@tcp:93/0 lens 504/0 e 0 to 0 dl 1788792148 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788792137.503415:0:24175:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c6043c97800 with x1875683760583552 ext(0->8) 00002000:00010000:1.0:1788792137.503423:0:24175:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c6043c97800 00000100:00100000:1.0:1788792137.503463:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:1.0:1788792137.503474:0:24175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+8:2419:x1875683760583552:12345-192.168.201.20@tcp:4:bash.0 00000100:00100000:0.0:1788792137.505018:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683760583680 00000100:00100000:0.0:1788792137.505029:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683760583680 00000100:00100000:0.0:1788792137.505086:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:0.0:1788792137.505094:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c6043c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+11:2419:x1875683760583680:12345-192.168.201.20@tcp:16:kworker.0 00000100:00100000:1.0:1788792137.505733:0:24175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+11:2419:x1875683760583552:12345-192.168.201.20@tcp:4:bash.0 Request processed in 2255us (2512us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788792137.505757:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00002000:00100000:1.0:1788792137.505770:0:24175:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff8c6043c97800 x1875683760583552/t12884901895(0) o4->f7fc150c-125b-4591-9e6f-98bd2b6bdc11@192.168.201.20@tcp:93/0 lens 504/448 e 0 to 0 dl 1788792148 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788792137.505782:0:24175:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c6043c97800 with x1875683760583552 ext(0->8) 00002000:00010000:1.0:1788792137.505787:0:24175:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c6043c97800 00000001:00080000:1.0:1788792137.510356:0:24166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:1.0:1788792137.510375:0:24166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000100:00100000:0.0:1788792137.510575:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c6043c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7fc150c-125b-4591-9e6f-98bd2b6bdc11+6:2419:x1875683760583680:12345-192.168.201.20@tcp:16:kworker.0 Request processed in 5473us (7425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788792137.510587:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00010000:00010000:3.0:1788792137.750868:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14783 lines, 14783 kept, 0 dropped, 0 bad.