00000100:00100000:0.0F:1787868963.556726:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868963.556808:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868963.556849:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868963.556881:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868963.556911:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918614912 00000100:00100000:0.0:1787868963.556920:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918614912 00000100:00100000:0.0:1787868963.556965:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 169 00000100:00100000:0.0:1787868963.556975:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+13:2403:x1874715918614912:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868963.557065:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+13:2403:x1874715918614912:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 90us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868963.557073:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 169 00000100:00100000:0.0:1787868963.557109:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918615040 00000100:00100000:0.0:1787868963.557112:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918615040 00000100:00100000:0.0:1787868963.557181:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918615168 00000100:00100000:0.0:1787868963.557185:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918615168 00000100:00100000:0.0:1787868963.557202:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:0.0:1787868963.557209:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+26:2403:x1874715918615040:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868963.557245:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+26:2403:x1874715918615040:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 37us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868963.557252:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:0.0:1787868963.557265:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:0.0:1787868963.557272:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2403:x1874715918615168:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868963.557295:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2403:x1874715918615168:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868963.557301:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00080000:0.0:1787868963.557318:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787868963.557321:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0F:1787868963.557511:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918615296 00000100:00100000:2.0:1787868963.557522:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918615296 00000100:00100000:2.0:1787868963.557585:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:2.0:1787868963.557593:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2403:x1874715918615296:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868963.557624:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2403:x1874715918615296:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868963.557632:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:2.0:1787868963.573916:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868963.575419:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868963.575444:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868963.575531:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918615552 00000100:00100000:0.0:1787868963.575542:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918615552 00000100:00100000:0.0:1787868963.575635:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:0.0:1787868963.575646:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:2404:x1874715918615552:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868963.575739:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:2404:x1874715918615552:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 94us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868963.575747:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00080000:0.0:1787868963.575775:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0F:1787868963.596204:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918615424 00000100:00100000:3.0:1787868963.596242:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918615424 00000100:00100000:3.0:1787868963.596376:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868963.596434:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868963.596528:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918615808 00000100:00100000:3.0:1787868963.596533:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918615808 00000100:00100000:3.0:1787868963.596570:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918615936 00000100:00100000:3.0:1787868963.596573:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918615936 00000100:00100000:3.0:1787868963.596604:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:3.0:1787868963.596614:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2402:x1874715918615424:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:3.0:1787868963.596648:0:19034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e66c 00000100:00080000:3.0:1787868963.596664:0:19034:0:(import.c:65:import_set_state_nolock()) ffff93d987fb6800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787868963.596883:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918615680 00000100:00100000:2.0:1787868963.596887:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918615680 00000100:00100000:2.0:1787868963.596925:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:2.0:1787868963.596932:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f24169c3-92a7-4501-a36f-f9f115268206+5:2403:x1874715918615680:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868963.596996:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f24169c3-92a7-4501-a36f-f9f115268206+5:2403:x1874715918615680:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 65us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868963.597003:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:2.0:1787868963.597027:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:2.0:1787868963.597034:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f24169c3-92a7-4501-a36f-f9f115268206+5:2402:x1874715918615808:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:2.0:1787868963.597048:0:20228:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e6a4 00000100:00080000:2.0:1787868963.597060:0:20228:0:(import.c:65:import_set_state_nolock()) ffff93d98891f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787868963.597101:0:20228:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1787868963.597305:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f24169c3-92a7-4501-a36f-f9f115268206+2:2402:x1874715918615808:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 270us (21858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868963.597313:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:2.0:1787868963.597327:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:2.0:1787868963.597334:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f24169c3-92a7-4501-a36f-f9f115268206+5:2402:x1874715918615936:12345-192.168.204.27@tcp:9:kworker.0 00000020:00000080:2.0:1787868963.597356:0:20228:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e6ab 00000100:00080000:2.0:1787868963.597362:0:20228:0:(import.c:65:import_set_state_nolock()) ffff93d981c09800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787868963.597388:0:20228:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787868963.597467:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f24169c3-92a7-4501-a36f-f9f115268206+2:2402:x1874715918615936:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 131us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868963.597474:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00010000:00010000:2.0:1787868963.597679:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868963.597697:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787868963.597728:0:19034:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787868963.597794:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+2:2402:x1874715918615424:12345-192.168.204.27@tcp:9:kworker.0 Request processed in 1180us (23891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868963.597801:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00010000:00010000:2.0:1787868963.597822:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787868963.597840:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787868963.597845:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787868963.597847:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787868963.629891:0:17068:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:2.0:1787868963.629929:0:17068:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93dabd8c09c0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:2.0:1787868963.629935:0:17068:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93dab5b3cb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93dabd8c0600 00000020:00080000:2.0:1787868963.629939:0:17068:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93dab5b3c600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d981b01800 00010000:00010000:1.0F:1787868963.629972:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2e9ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868963.629996:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2e9ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868963.630004:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2e9ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868963.630010:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787868963.630015:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2e9ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868963.630023:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2e9ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868963.630042:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93dab5e05900) 00010000:00010000:1.0:1787868963.630045:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787868963.630050:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2e9ad lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787868963.630056:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d400/0x2f11f4d3bde2e9ad lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787868963.630088:0:17128:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1787868963.630183:0:17128:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1787868963.747659:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868964.641942:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939665024:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.642022:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.642071:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939665536:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.642142:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.642183:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939666048:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.642234:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.642250:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939666560:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.642269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.642291:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787868964.642297:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939665408:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.642321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.642337:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939665920:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.642356:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.642378:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939666432:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.642401:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.642428:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939665152:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.642453:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.642484:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939665664:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.642504:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.642520:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939666176:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.642539:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.642647:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787868964.642653:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939665280:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.642677:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.642692:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939665792:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.642711:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.642726:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939666304:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.642746:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.642774:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939665024 00000100:00100000:3.0:1787868964.642782:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939665024 00000100:00100000:3.0:1787868964.642829:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787868964.642838:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+24:3639:x1874715939665024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.642887:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:431a2c34-804b-46dd-9d1f-913354b6c612+24:3639:x1874715939665024:12345-0@lo:400:kworker.0 Request processed in 50us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868964.642894:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787868964.642925:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939665536 00000100:00100000:3.0:1787868964.642929:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939665536 00000100:00100000:3.0:1787868964.642949:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939666048 00000100:00100000:3.0:1787868964.642951:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939666048 00000100:00100000:3.0:1787868964.642975:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939666560 00000100:00100000:3.0:1787868964.642978:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939666560 00000100:00100000:3.0:1787868964.643000:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939666432 00000100:00100000:3.0:1787868964.643003:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939666432 00000100:00100000:3.0:1787868964.643015:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939666176 00000100:00100000:3.0:1787868964.643018:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939666176 00000100:00100000:3.0:1787868964.643030:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939666304 00000100:00100000:3.0:1787868964.643032:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939666304 00000100:00100000:3.0:1787868964.643061:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787868964.643068:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939665536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.643101:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939665536:12345-0@lo:400:kworker.0 Request processed in 35us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868964.643109:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787868964.643123:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787868964.643128:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939666048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.643176:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939666048:12345-0@lo:400:kworker.0 Request processed in 26us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868964.643182:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787868964.643193:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787868964.643198:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939666560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.643222:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939666560:12345-0@lo:400:kworker.0 Request processed in 25us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868964.643227:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787868964.643235:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787868964.643240:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939666432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.643261:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939666432:12345-0@lo:400:kworker.0 Request processed in 21us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868964.643276:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787868964.643288:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787868964.643294:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939666176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.643329:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939666176:12345-0@lo:400:kworker.0 Request processed in 35us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868964.643334:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787868964.643347:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787868964.643353:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939666304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.643378:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939666304:12345-0@lo:400:kworker.0 Request processed in 26us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868964.643384:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787868964.643403:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939665152 00000100:00100000:3.0:1787868964.643406:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939665152 00000100:00100000:3.0:1787868964.643425:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939665664 00000100:00100000:3.0:1787868964.643427:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939665664 00000100:00100000:3.0:1787868964.643440:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787868964.643447:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939665152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.643492:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939665152:12345-0@lo:400:kworker.0 Request processed in 46us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868964.643499:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787868964.643511:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787868964.643517:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939665664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868964.644094:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939665408 00000100:00100000:2.0:1787868964.644099:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939665408 00000100:00100000:2.0:1787868964.644133:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939665920 00000100:00100000:2.0:1787868964.644136:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939665920 00000100:00100000:2.0:1787868964.644180:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939665280 00000100:00100000:2.0:1787868964.644184:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939665280 00000100:00100000:2.0:1787868964.644196:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939665792 00000100:00100000:2.0:1787868964.644206:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939665792 00000100:00100000:2.0:1787868964.644231:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787868964.644239:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939665408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.644304:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939665664:12345-0@lo:400:kworker.0 Request processed in 787us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868964.644312:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787868964.644343:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868964.644355:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939666688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868964.648780:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939665408:12345-0@lo:400:kworker.0 Request processed in 4530us (6446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868964.648797:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787868964.648836:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787868964.648849:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939665920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868964.648906:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939665920:12345-0@lo:400:kworker.0 Request processed in 62us (6549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868964.648912:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787868964.648924:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787868964.648931:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939665280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868964.648961:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939665280:12345-0@lo:400:kworker.0 Request processed in 31us (6283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868964.648967:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787868964.648978:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787868964.648985:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939665792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868964.649015:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939665792:12345-0@lo:400:kworker.0 Request processed in 30us (6303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868964.649020:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787868964.649055:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787868964.649060:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787868964.649063:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787868964.649067:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787868964.649232:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.649309:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1787868964.649315:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93dab7fbc780, transno 8589934596 00000004:00080000:3.0:1787868964.649329:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1787868964.649355:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939665280:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.649370:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939665792:0@lo:400:kworker.0 00010000:00080000:3.0:1787868964.649386:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9888c2940 x1874715939666304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868964.649399:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939666304:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.649412:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939665152:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.649425:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939665664:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.649439:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939666176:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.649727:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939665408:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.649738:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939665920:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.649749:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939666432:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.649760:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939665024:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.649773:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939665536:0@lo:400:kworker.0 00000100:00100000:3.0:1787868964.649784:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939666048:0@lo:400:kworker.0 00010000:00080000:3.0:1787868964.649796:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9863c1e00 x1874715939666560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868964.649819:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939666560:0@lo:400:kworker.0 00000100:00100000:2.0:1787868964.651119:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939666688 00000100:00100000:2.0:1787868964.651129:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939666688 00000100:00100000:2.0:1787868964.651225:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787868964.651235:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939666688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787868964.651265:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787868964.651335:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939666688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868964.651343:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787868964.651591:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939666816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868964.651633:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868964.651679:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939666688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868964.651822:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939666816 00000100:00100000:2.0:1787868964.651826:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939666816 00000100:00100000:2.0:1787868964.651859:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787868964.651866:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939666816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787868964.651877:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787868964.651916:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939666816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868964.651922:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787868964.652026:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939666816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787868964.779332:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868965.794140:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868966.690300:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939666944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868966.690615:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868966.698271:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939666944 00000100:00100000:2.0:1787868966.698283:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939666944 00000100:00100000:2.0:1787868966.698347:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787868966.698360:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939666944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787868966.698408:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787868966.699274:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939666944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 914us (8654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868966.699287:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787868966.699320:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868966.699542:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939666944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787868966.699564:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787868966.699575:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939667072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787868966.699625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868966.699673:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939667072 00000100:00100000:0.0:1787868966.699679:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939667072 00000100:00100000:0.0:1787868966.699722:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787868966.699731:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939667072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868966.699748:0:18599:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787868966.699785:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939667072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868966.699792:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787868966.699809:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868966.699830:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939667072:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787868966.817700:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868967.012954:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868967.013300:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918616064 00000100:00100000:3.0:1787868967.013313:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918616064 00000100:00080000:0.0:1787868967.013409:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787868967.013465:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00100000:3.0:1787868967.013479:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+12:15590:x1874715918616064:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787868967.013607:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+12:15590:x1874715918616064:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 132us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868967.013615:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 74 00000100:00100000:0.0:1787868967.023247:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868967.023652:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918616192 00000100:00100000:2.0:1787868967.023664:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918616192 00000100:00100000:2.0:1787868967.023771:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00100000:2.0:1787868967.023784:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9881921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:15590:x1874715918616192:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787868967.023923:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9881921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:15590:x1874715918616192:12345-192.168.204.27@tcp:60:lhsmtool_posix.0 Request processed in 142us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868967.023931:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 75 00000100:00080000:0.0:1787868967.024071:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868967.032613:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868967.032874:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918616448 00000100:00100000:3.0:1787868967.032885:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918616448 00000100:00100000:3.0:1787868967.032952:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1787868967.032964:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986c13850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+12:15590:x1874715918616448:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787868967.033271:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986c13850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+13:15590:x1874715918616448:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 308us (667us total) trans 8589934636 rc 0/0 00000100:00100000:3.0:1787868967.033278:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000040:00080000:2.0:1787868967.524914:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787868967.715845:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939667200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787868967.715953:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868967.716292:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939667200 00000100:00100000:1.0:1787868967.716300:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939667200 00000100:00100000:0.0:1787868967.716455:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868967.716466:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939667328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868967.716496:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868967.732242:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939667328 00000100:00100000:1.0:1787868967.732262:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939667328 00000100:00100000:1.0:1787868967.732337:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787868967.732348:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939667200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787868967.732390:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787868967.732565:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939667200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 219us (16611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868967.732588:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787868967.732608:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787868967.732615:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939667328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787868967.732634:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787868967.732668:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939667328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (16171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868967.732674:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787868967.732880:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939667328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868967.732898:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939667200:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787868967.841422:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868968.669280:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868968.669334:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868968.669370:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868968.669400:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868968.669425:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868968.669436:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918616576 00000100:00100000:2.0:1787868968.669449:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918616576 00000100:00100000:1.0:1787868968.669463:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868968.669509:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 171 00000100:00100000:1.0:1787868968.669516:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918616832 00000100:00100000:2.0:1787868968.669523:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+13:2404:x1874715918616576:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868968.669523:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918616832 00000100:00100000:1.0:1787868968.669554:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918617088 00000100:00100000:1.0:1787868968.669559:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918617088 00000100:00100000:1.0:1787868968.669586:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918616704 00000100:00100000:1.0:1787868968.669589:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918616704 00000100:00100000:1.0:1787868968.669602:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918617216 00000100:00100000:1.0:1787868968.669607:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918617216 00000100:00100000:2.0:1787868968.669608:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:847e79f0-919e-4251-863a-9b10feb7d22a+13:2404:x1874715918616576:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 87us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868968.669618:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 171 00000100:00100000:1.0:1787868968.669627:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 85 00000100:00100000:1.0:1787868968.669635:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2404:x1874715918616832:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868968.669657:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918616960 00000100:00100000:2.0:1787868968.669663:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918616960 00000100:00100000:1.0:1787868968.669675:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2404:x1874715918616832:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 40us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868968.669683:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 85 00000100:00100000:1.0:1787868968.669701:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:2.0:1787868968.669705:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:2.0:1787868968.669713:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f56580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2404:x1874715918616960:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868968.669741:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f56580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2404:x1874715918616960:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 29us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868968.669747:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:1.0:1787868968.669852:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:2404:x1874715918617088:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:0.0:1787868968.669931:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868968.669977:0:17089:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787868968.669986:0:17089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787868968.670107:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 87 00000100:00100000:3.0:1787868968.670115:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+13:2404:x1874715918616704:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:0.0:1787868968.670202:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787868968.670206:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868968.670867:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:2404:x1874715918617088:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 1014us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868968.670876:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 86 00000100:00100000:1.0:1787868968.670951:0:17090:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787868968.670963:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 88 00000100:00100000:1.0:1787868968.670972:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+5:2404:x1874715918617216:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868968.671008:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+5:2404:x1874715918617216:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 39us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868968.671014:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 88 00000100:00100000:3.0:1787868968.674696:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+13:2404:x1874715918616704:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 4569us (5283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868968.674776:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 87 00010000:00010000:3.0:1787868968.866422:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868969.767281:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939667584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868969.767412:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868969.767486:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939668096:0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.767523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868969.767562:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939668608:0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.767591:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868969.767613:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939669120:0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.767637:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868969.767660:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1787868969.767667:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939667456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868969.767702:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868969.767703:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939668608 00000100:00100000:1.0:1787868969.767712:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939668608 00000100:00100000:0.0:1787868969.767722:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939667968:0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.767745:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868969.767760:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939668480:0@lo:400:kworker.0 00000100:00100000:1.0:1787868969.767767:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939669120 00000100:00100000:1.0:1787868969.767773:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939669120 00000100:00100000:1.0:1787868969.767808:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787868969.767818:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939668608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868969.767884:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939668608:12345-0@lo:400:kworker.0 Request processed in 56us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868969.767891:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787868969.767908:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787868969.767914:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939669120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868969.767940:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939669120:12345-0@lo:400:kworker.0 Request processed in 27us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868969.767946:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1787868969.767961:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868969.767982:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939667584 00000100:00100000:1.0:1787868969.767993:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939667584 00000100:00100000:1.0:1787868969.768017:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939667456 00000100:00100000:1.0:1787868969.768020:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939667456 00000100:00100000:1.0:1787868969.768034:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787868969.768039:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939667584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787868969.768061:0:18599:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787868969.768096:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939667584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868969.768103:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787868969.768114:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787868969.768120:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939667456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787868969.768130:0:18599:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787868969.768403:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939667840:0@lo:400:kworker.0 00000100:00100000:3.0:1787868969.768587:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939668096 00000100:00100000:3.0:1787868969.768591:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939668096 00000100:00100000:3.0:1787868969.768621:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939667968 00000100:00100000:3.0:1787868969.768624:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939667968 00000100:00100000:3.0:1787868969.768642:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787868969.768649:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939668096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.769672:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868969.772101:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939668992:0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.772186:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868969.772234:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939668608:0@lo:400:kworker.0 00010000:00080000:0.0:1787868969.772251:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed08b40 x1874715939669120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868969.772262:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939669120:0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.772286:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939667584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868969.772341:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939668480 00000100:00100000:0.0:1787868969.772347:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939668480 00000100:00100000:0.0:1787868969.772408:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787868969.772419:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939667968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.772479:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939667968:12345-0@lo:400:kworker.0 Request processed in 61us (4731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868969.772487:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787868969.772505:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787868969.772512:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939668480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.773726:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939668480:12345-0@lo:400:kworker.0 Request processed in 1209us (4052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868969.773737:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787868969.774069:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939667968:0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.774091:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939668480:0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.774127:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939668992 00000100:00100000:0.0:1787868969.774148:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939668992 00000100:00100000:1.0:1787868969.774188:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939667456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6065us (6482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868969.774198:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787868969.774227:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787868969.774238:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939668992:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787868969.774275:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787868969.774281:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787868969.774283:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868969.774298:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874715939668992:12345-0@lo:400:kworker.0 Request processed in 63us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868969.774305:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939667712:0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.774308:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787868969.774353:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939667456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787868969.774372:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868969.774385:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3639:1874715939668992:0@lo:400:kworker.0 00000100:00100000:1.0:1787868969.774418:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939668224:0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.774440:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939667712 00000100:00100000:0.0:1787868969.774445:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939667712 00000100:00100000:1.0:1787868969.774450:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868969.774472:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939668736:0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.774484:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787868969.774493:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+24:3636:x1874715939667712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868969.774500:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868969.774544:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939667712:0@lo:400:kworker.0 00000100:00100000:1.0:1787868969.774561:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939668224 00000100:00100000:1.0:1787868969.774569:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939668224 00000100:00100000:1.0:1787868969.774591:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939668736 00000100:00100000:1.0:1787868969.774593:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939668736 00000100:00100000:1.0:1787868969.774610:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787868969.774615:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939668224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868969.774999:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:431a2c34-804b-46dd-9d1f-913354b6c612+24:3636:x1874715939667712:12345-0@lo:400:kworker.0 Request processed in 506us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868969.775006:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787868969.775038:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787868969.775046:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939668736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868969.775853:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868969.775900:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939668352:0@lo:400:kworker.0 00000100:00100000:2.0:1787868969.775969:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868969.775986:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939668864:0@lo:400:kworker.0 00000100:00100000:2.0:1787868969.776015:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868969.776088:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939667840 00000100:00100000:2.0:1787868969.776094:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939667840 00000100:00100000:2.0:1787868969.776121:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939668352 00000100:00100000:2.0:1787868969.776124:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939668352 00000100:00100000:2.0:1787868969.776134:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787868969.776140:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939667840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868969.776192:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939667840:12345-0@lo:400:kworker.0 Request processed in 52us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868969.776198:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787868969.776211:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787868969.776216:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939668352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868969.776238:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939668352:12345-0@lo:400:kworker.0 Request processed in 22us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868969.776242:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787868969.776273:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939667840:0@lo:400:kworker.0 00000100:00100000:2.0:1787868969.776282:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939668352:0@lo:400:kworker.0 00000100:00100000:2.0:1787868969.776304:0:20428:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787868969.776311:0:20428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1787868969.776417:0:20428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939668864 00000100:00100000:2.0:1787868969.776420:0:20428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939668864 00000100:00100000:2.0:1787868969.776442:0:20428:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787868969.776448:0:20428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787868969.776453:0:20428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939668864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787868969.776484:0:20428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939668864:12345-0@lo:400:kworker.0 Request processed in 32us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868969.776490:0:20428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1787868969.776521:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabed083c0 x1874715939668864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868969.776531:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939668864:0@lo:400:kworker.0 00000100:00100000:1.0:1787868969.778600:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939668224:12345-0@lo:400:kworker.0 Request processed in 3975us (4143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868969.778615:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000001:00080000:2.0:1787868969.778975:0:17068:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:2.0:1787868969.778984:0:17068:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1787868969.779002:0:17128:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1787868969.779012:0:17128:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00080000:2.0:1787868969.779100:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787868969.779106:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868969.779151:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939668224:0@lo:400:kworker.0 00000001:00100000:1.0:1787868969.779223:0:18591:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f24169c3-92a7-4501-a36f-f9f115268206 00000020:00000080:1.0:1787868969.779228:0:18591:0:(genops.c:885:class_export_put()) final put ffff93d988919800/f24169c3-92a7-4501-a36f-f9f115268206 00000020:00000080:2.0:1787868969.779259:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d988919800/f24169c3-92a7-4501-a36f-f9f115268206 for lustre-OST0000 00000020:00000080:2.0:1787868969.779304:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d98891f000 for lustre-OST0000 00000100:00100000:3.0:1787868969.779520:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939668096:12345-0@lo:400:kworker.0 Request processed in 10868us (11995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868969.779530:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787868969.779635:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939668096:0@lo:400:kworker.0 00000001:00100000:3.0:1787868969.780185:0:19410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3b83fde6-fad6-4b0f-a839-62ce511e8e7d 00000020:00000080:3.0:1787868969.780189:0:19410:0:(genops.c:885:class_export_put()) final put ffff93d987fb3000/3b83fde6-fad6-4b0f-a839-62ce511e8e7d 00000001:00100000:3.0:1787868969.780206:0:19410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f24169c3-92a7-4501-a36f-f9f115268206 00000020:00000080:3.0:1787868969.780208:0:19410:0:(genops.c:885:class_export_put()) final put ffff93d981c0b000/f24169c3-92a7-4501-a36f-f9f115268206 00000020:00000080:2.0:1787868969.780223:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d987fb3000/3b83fde6-fad6-4b0f-a839-62ce511e8e7d for lustre-OST0001 00000100:00100000:0.0:1787868969.780385:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939668736:12345-0@lo:400:kworker.0 Request processed in 5338us (5885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868969.780394:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787868969.780606:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939668736:0@lo:400:kworker.0 00000020:00000080:2.0:1787868969.784791:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d981c0b000/f24169c3-92a7-4501-a36f-f9f115268206 for lustre-OST0001 00000020:00000080:2.0:1787868969.785009:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d987fb6800 for lustre-OST0001 00000020:00000080:2.0:1787868969.785014:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d981c09800 for lustre-OST0001 00010000:00010000:2.0:1787868969.889351:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868970.916101:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868971.811187:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939669248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787868971.811253:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868971.811294:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787868971.811301:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939669376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787868971.811351:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868971.811424:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939669248 00000100:00100000:1.0:1787868971.811432:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939669248 00000100:00100000:1.0:1787868971.811489:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939669376 00000100:00100000:1.0:1787868971.811492:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939669376 00000100:00100000:1.0:1787868971.811508:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787868971.811517:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939669248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787868971.811546:0:18599:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787868971.811590:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939669248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868971.811598:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787868971.811614:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787868971.811620:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939669376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787868971.811628:0:18599:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787868971.811661:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939669376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868971.811667:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787868971.811718:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939669376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868971.811730:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939669248:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787868971.811894:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787868971.938550:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787868972.216797:0:20466:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 18:16:10 (1787868970) 00000040:00080000:0.0:1787868972.641367:0:17124:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787868972.641376:0:17124:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787868972.641394:0:17124:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787868972.641400:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787868972.834353:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988242940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939669504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868972.834440:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868972.834596:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939669504 00000100:00100000:3.0:1787868972.834604:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939669504 00000100:00100000:3.0:1787868972.834673:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787868972.834684:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939669504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787868972.834720:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1787868972.834773:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939669504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868972.834780:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787868972.834827:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988242940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939669504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787868972.848602:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939669632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787868972.848692:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868972.848862:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939669632 00000100:00100000:2.0:1787868972.848872:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939669632 00000100:00100000:2.0:1787868972.848928:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787868972.848938:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939669632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787868972.848973:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787868972.849027:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939669632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868972.849050:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787868972.852061:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939669632:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787868972.961485:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868973.791584:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868973.791635:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868973.791662:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868973.791689:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868973.791714:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868973.791740:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868973.791774:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918617728 00000100:00100000:2.0:1787868973.791784:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918617728 00000100:00100000:2.0:1787868973.791841:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:2.0:1787868973.791852:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2405:x1874715918617728:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868973.791927:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2405:x1874715918617728:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 78us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868973.791936:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:2.0:1787868973.791959:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918617344 00000100:00100000:2.0:1787868973.791963:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918617344 00000100:00100000:2.0:1787868973.791988:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 173 00000100:00100000:2.0:1787868973.791994:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+13:2405:x1874715918617344:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868973.792020:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+13:2405:x1874715918617344:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868973.792027:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 173 00000100:00100000:2.0:1787868973.792054:0:20429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918617472 00000100:00100000:2.0:1787868973.792057:0:20429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918617472 00000100:00100000:2.0:1787868973.792083:0:20429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918617984 00000100:00100000:2.0:1787868973.792086:0:20429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918617984 00000100:00100000:2.0:1787868973.792117:0:20429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918617600 00000100:00100000:2.0:1787868973.792120:0:20429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918617600 00000100:00100000:2.0:1787868973.792131:0:20429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918617856 00000100:00100000:2.0:1787868973.792133:0:20429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918617856 00000100:00100000:2.0:1787868973.792147:0:20429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:2.0:1787868973.792169:0:20429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+12:2405:x1874715918617472:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868973.792199:0:20429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+12:2405:x1874715918617472:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 46us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868973.792211:0:20429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 95 00000100:00100000:2.0:1787868973.792223:0:20429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 96 00000100:00100000:2.0:1787868973.792229:0:20429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f24169c3-92a7-4501-a36f-f9f115268206+5:2405:x1874715918617984:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868973.792253:0:20429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f24169c3-92a7-4501-a36f-f9f115268206+5:2405:x1874715918617984:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868973.792259:0:20429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 96 00000100:00100000:2.0:1787868973.792270:0:20429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 97 00000100:00100000:2.0:1787868973.792276:0:20429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da930903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2405:x1874715918617600:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868973.792314:0:20429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da930903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2405:x1874715918617600:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 39us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868973.792320:0:20429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 97 00000100:00100000:2.0:1787868973.792330:0:20429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00100000:2.0:1787868973.792336:0:20429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93090f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f24169c3-92a7-4501-a36f-f9f115268206+6:2405:x1874715918617856:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787868973.792372:0:20429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93090f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f24169c3-92a7-4501-a36f-f9f115268206+6:2405:x1874715918617856:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 36us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868973.792377:0:20429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 98 00000100:00080000:2.0:1787868973.792397:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787868973.792406:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787868973.792408:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787868973.987014:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868974.882092:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787868974.882124:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939669760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787868974.882236:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868974.882341:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939669760 00000100:00100000:3.0:1787868974.882350:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939669760 00000100:00100000:1.0:1787868974.883726:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787868974.883745:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939669888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787868974.883802:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868974.883843:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939669888 00000100:00100000:1.0:1787868974.883849:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939669888 00000100:00100000:1.0:1787868974.883901:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787868974.883913:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939669888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787868974.883947:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1787868974.884404:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787868974.884461:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939669888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787868974.884702:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939670016:0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.884745:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868974.884767:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939670016 00000100:00100000:3.0:1787868974.884773:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939670016 00000100:00100000:0.0:1787868974.884777:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939670528:0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.884810:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868974.884814:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787868974.884826:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:3638:x1874715939670016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.884835:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939671040:0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.884873:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868974.884880:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:3638:x1874715939670016:12345-0@lo:400:kworker.0 Request processed in 56us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868974.884889:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787868974.884906:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939670016:0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.884921:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787868974.884929:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939670144:0@lo:400:kworker.0 00000100:00100000:3.0:1787868974.884936:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939670528 00000100:00100000:0.0:1787868974.884958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868974.884960:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939670528 00000100:00100000:0.0:1787868974.884982:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939670656:0@lo:400:kworker.0 00000100:00100000:3.0:1787868974.884983:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939670144 00000100:00100000:3.0:1787868974.884987:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939670144 00000100:00100000:3.0:1787868974.885001:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787868974.885009:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939670528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.885028:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868974.885056:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939671168:0@lo:400:kworker.0 00000100:00100000:3.0:1787868974.885058:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939670528:12345-0@lo:400:kworker.0 Request processed in 49us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868974.885068:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787868974.885081:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787868974.885088:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939670144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.885096:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868974.885132:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939670144:12345-0@lo:400:kworker.0 Request processed in 44us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868974.885136:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939670528:0@lo:400:kworker.0 00000100:00100000:3.0:1787868974.885144:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787868974.885205:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939670656 00000100:00100000:0.0:1787868974.885205:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939670144:0@lo:400:kworker.0 00000100:00100000:3.0:1787868974.885211:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939670656 00000100:00080000:0.0:1787868974.885229:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787868974.885234:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868974.885244:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787868974.885246:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939670272:0@lo:400:kworker.0 00000100:00100000:3.0:1787868974.885255:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939670656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.885288:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868974.885314:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939670784:0@lo:400:kworker.0 00000100:00100000:3.0:1787868974.885319:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939670656:12345-0@lo:400:kworker.0 Request processed in 65us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868974.885329:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787868974.885343:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939670272 00000100:00100000:3.0:1787868974.885347:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939670272 00000100:00100000:0.0:1787868974.885360:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868974.885380:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939671296:0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.885401:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868974.885422:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787868974.885428:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939670400:0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.885449:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868974.885465:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939670912:0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.885490:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868974.885539:0:20428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939671040 00000100:00100000:0.0:1787868974.885543:0:20428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939671040 00000100:00100000:0.0:1787868974.885568:0:20428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939671168 00000100:00100000:0.0:1787868974.885571:0:20428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939671168 00000100:00100000:0.0:1787868974.885584:0:20428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939670784 00000100:00100000:0.0:1787868974.885587:0:20428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939670784 00000100:00100000:0.0:1787868974.885599:0:20428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939671296 00000100:00100000:0.0:1787868974.885601:0:20428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939671296 00000100:00100000:0.0:1787868974.885612:0:20428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939670400 00000100:00100000:0.0:1787868974.885614:0:20428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939670400 00000100:00100000:0.0:1787868974.885623:0:20428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939670912 00000100:00100000:0.0:1787868974.885625:0:20428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939670912 00000100:00100000:0.0:1787868974.885639:0:20428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787868974.885647:0:20428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939671040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.885682:0:20428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939671040:12345-0@lo:400:kworker.0 Request processed in 36us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868974.885689:0:20428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787868974.885702:0:20428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787868974.885708:0:20428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939671168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.885736:0:20428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939671168:12345-0@lo:400:kworker.0 Request processed in 27us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868974.885748:0:20428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787868974.885762:0:20428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787868974.885768:0:20428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939670784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.885802:0:20428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939670784:12345-0@lo:400:kworker.0 Request processed in 35us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868974.885808:0:20428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787868974.885819:0:20428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787868974.885825:0:20428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939671296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.885851:0:20428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939671296:12345-0@lo:400:kworker.0 Request processed in 27us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868974.885856:0:20428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787868974.885867:0:20428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787868974.885873:0:20428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93368f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939670400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.885899:0:20428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93368f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939670400:12345-0@lo:400:kworker.0 Request processed in 27us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868974.885905:0:20428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787868974.885915:0:20428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787868974.885920:0:20428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939670912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.885944:0:20428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939670912:12345-0@lo:400:kworker.0 Request processed in 24us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868974.885949:0:20428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787868974.885984:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939670400:0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.885995:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939670912:0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.886016:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939670784:0@lo:400:kworker.0 00010000:00080000:0.0:1787868974.886027:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f56940 x1874715939671296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868974.886037:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939671296:0@lo:400:kworker.0 00000100:00080000:0.0:1787868974.886093:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787868974.886097:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787868974.886099:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868974.886114:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939670656:0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.886125:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939671168:0@lo:400:kworker.0 00010000:00080000:0.0:1787868974.886135:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab6f552c0 x1874715939671040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868974.886143:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939671040:0@lo:400:kworker.0 00000100:00100000:1.0:1787868974.886938:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939669888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3021us (3129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868974.886949:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787868974.886974:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787868974.886995:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939669760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787868974.887013:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787868974.887070:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939669760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (4835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868974.887076:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787868974.888055:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787868974.888067:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939670272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868974.888168:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939670272:12345-0@lo:400:kworker.0 Request processed in 90us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868974.888176:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787868974.888594:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939670272:0@lo:400:kworker.0 00000100:00100000:0.0:1787868974.892678:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939669760:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787868975.009700:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868976.033690:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868976.930018:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868976.930051:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939671424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868976.930180:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868976.930388:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939671424 00000100:00100000:3.0:1787868976.930397:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939671424 00000100:00100000:3.0:1787868976.930478:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787868976.930504:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939671424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787868976.930545:0:18599:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787868976.930602:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939671424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868976.930610:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787868976.930719:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787868976.930779:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939671424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868976.931527:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93092d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939671552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787868976.931591:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868976.931714:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939671552 00000100:00100000:2.0:1787868976.931720:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939671552 00000100:00100000:2.0:1787868976.931778:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787868976.931788:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939671552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787868976.931804:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787868976.931844:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939671552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868976.931850:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787868976.932048:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868976.932124:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93092d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939671552:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787868977.058201:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868977.206801:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868977.206852:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868977.206898:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868977.207098:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918618112 00000100:00100000:0.0:1787868977.207110:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918618112 00000100:00100000:0.0:1787868977.207207:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918618368 00000100:00100000:0.0:1787868977.207211:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918618368 00000100:00100000:0.0:1787868977.207236:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918618240 00000100:00100000:0.0:1787868977.207239:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918618240 00000100:00100000:0.0:1787868977.207256:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:0.0:1787868977.207267:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93093c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:847e79f0-919e-4251-863a-9b10feb7d22a+15:2406:x1874715918618112:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868977.207284:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868977.207326:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987287400/0x2f11f4d3bde2e642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff342 expref: 15 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868977.207368:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868977.207425:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93093c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:847e79f0-919e-4251-863a-9b10feb7d22a+14:2406:x1874715918618112:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 160us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868977.207612:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:0.0:1787868977.207636:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1787868977.207643:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da930930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:847e79f0-919e-4251-863a-9b10feb7d22a+13:2406:x1874715918618368:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868977.207667:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868977.207678:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd870200/0x2f11f4d3bde2e6ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff429 expref: 13 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868977.207688:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868977.207709:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da930930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:847e79f0-919e-4251-863a-9b10feb7d22a+12:2406:x1874715918618368:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 67us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868977.207716:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1787868977.207731:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:0.0:1787868977.207737:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93091e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:847e79f0-919e-4251-863a-9b10feb7d22a+11:2406:x1874715918618240:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787868977.207745:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868977.207753:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac2070000/0x2f11f4d3bde2e649 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff373 expref: 11 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868977.207763:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868977.207780:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93091e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:847e79f0-919e-4251-863a-9b10feb7d22a+10:2406:x1874715918618240:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 44us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868977.207786:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:2.0:1787868977.220973:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868977.221082:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918618624 00000100:00100000:0.0:1787868977.221107:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918618624 00000100:00100000:0.0:1787868977.221231:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:0.0:1787868977.221244:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93093840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+6:2402:x1874715918618624:12345-192.168.204.27@tcp:9:umount.0 00000020:00000080:0.0:1787868977.221285:0:18594:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e665 00000020:00010000:0.0:1787868977.221319:0:18594:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93d981c0c800: total 0 00000100:00080000:0.0:1787868977.221326:0:18594:0:(import.c:65:import_set_state_nolock()) ffff93d981c0d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787868977.221696:0:18594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1787868977.221864:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93093840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+4:2402:x1874715918618624:12345-192.168.204.27@tcp:9:umount.0 Request processed in 620us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868977.221873:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00000020:00010000:2.0:1787868977.222328:0:17842:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93d981c0c800: total 0 00010000:00010000:2.0:1787868977.222333:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868977.222395:0:17842:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d981c0c800, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1787868977.222663:0:17842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787868977.222668:0:17842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1787868957 -> 1787868958 00002000:00010000:2.0:1787868977.222672:0:17842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787868957 -> 1787868958 00002000:00010000:2.0:1787868977.222674:0:17842:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787868977.222706:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077ac2373/0x2f11f4d3bde2e9de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff509 expref: 3 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868977.222744:0:17842:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d981c0c800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787868977.222759:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868977.222760:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868977.222762:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787868977.223202:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787868977.227522:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787868977.227683:0:20428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918619520 00000100:00100000:1.0:1787868977.227696:0:20428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918619520 00000100:00100000:1.0:1787868977.227781:0:20428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00100000:1.0:1787868977.227793:0:20428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93368780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+12:2402:x1874715918619520:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:1.0:1787868977.227826:0:20428:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e657 00000020:00010000:1.0:1787868977.227843:0:20428:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93dab523a000: total 0 00000100:00080000:1.0:1787868977.227848:0:20428:0:(import.c:65:import_set_state_nolock()) ffff93dab523a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787868977.227885:0:20428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:1.0:1787868977.228049:0:20428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93368780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+11:2402:x1874715918619520:12345-192.168.204.27@tcp:39:umount.0 Request processed in 258us (540us total) trans 8589934637 rc 0/0 00000100:00100000:1.0:1787868977.228058:0:20428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 76 00000100:00080000:3.0:1787868977.228202:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1787868977.228328:0:17077:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93dab523a000: total 0 00010000:00010000:2.0:1787868977.228567:0:17077:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93dab523a000, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1787868977.228607:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da93866c00) 00010000:00010000:2.0:1787868977.228611:0:17077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787868977.228621:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2e73e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff437 expref: 10 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868977.228649:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93daafdb5900) 00010000:00010000:2.0:1787868977.228652:0:17077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787868977.228656:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870400/0x2f11f4d3bde2e77d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff445 expref: 9 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868977.228670:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93dab5e05900) 00010000:00010000:2.0:1787868977.228673:0:17077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787868977.228676:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2e983 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4e6 expref: 8 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868977.228691:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93daafdb5a00) 00010000:00010000:2.0:1787868977.228694:0:17077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787868977.228698:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dabd870c00/0x2f11f4d3bde2e722 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff430 expref: 7 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868977.228714:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93da93866600) 00010000:00010000:2.0:1787868977.228730:0:17077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787868977.228736:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d400/0x2f11f4d3bde2e802 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff46f expref: 6 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868977.228754:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:2.0:1787868977.228757:0:17077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787868977.228761:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93daace1d600/0x2f11f4d3bde2e928 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff4d1 expref: 5 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868977.228963:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93daafdb5500) 00010000:00010000:2.0:1787868977.228967:0:17077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787868977.228971:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2e9ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff510 expref: 4 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868977.228991:0:17077:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93dab523a000, canceled 7 locks, left on hash table 0. 00010000:00010000:2.0:1787868977.229007:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868977.229009:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868977.229011:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868977.245140:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868977.245633:0:20429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918619648 00000100:00100000:0.0:1787868977.245644:0:20429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918619648 00000100:00100000:0.0:1787868977.245740:0:20429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 77 00000100:00100000:0.0:1787868977.245753:0:20429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+5:2402:x1874715918619648:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:0.0:1787868977.245788:0:20429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e65e 00000100:00080000:0.0:1787868977.245810:0:20429:0:(import.c:65:import_set_state_nolock()) ffff93dab523c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787868977.245843:0:20429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1787868977.246082:0:20429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b83fde6-fad6-4b0f-a839-62ce511e8e7d+3:2402:x1874715918619648:12345-192.168.204.27@tcp:39:umount.0 Request processed in 331us (952us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787868977.246092:0:20429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 77 00010000:00010000:1.0:1787868977.246878:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787868977.247671:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1787868977.762185:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787868977.953503:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868977.953533:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939671680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868977.953609:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868977.953975:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939671680 00000100:00100000:3.0:1787868977.953984:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939671680 00000100:00100000:3.0:1787868977.954034:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787868977.954044:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93090b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939671680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787868977.954086:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787868977.954144:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93090b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939671680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868977.954151:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787868977.954228:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939671680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787868977.955443:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da933683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939671808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868977.955498:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868977.955662:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939671808 00000100:00100000:0.0:1787868977.955669:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939671808 00000100:00100000:0.0:1787868977.955713:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787868977.955723:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da930921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939671808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787868977.955750:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787868977.955798:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da930921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939671808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868977.955819:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787868977.955858:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da933683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939671808:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787868978.081366:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868978.904111:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868978.904412:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918619904 00000100:00100000:0.0:1787868978.904422:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918619904 00000100:00100000:0.0:1787868978.904503:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 105 00000100:00100000:0.0:1787868978.904515:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93091a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:2403:x1874715918619904:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:0.0:1787868978.904825:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93091a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+6:2403:x1874715918619904:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 311us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868978.904833:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 105 00000100:00080000:3.0:1787868978.908542:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787868978.915248:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868978.915417:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868978.915835:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918619776 00000100:00100000:3.0:1787868978.915856:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918619776 00000100:00100000:3.0:1787868978.915950:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 175 00000100:00100000:3.0:1787868978.915964:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+10:2403:x1874715918619776:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787868978.916086:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:847e79f0-919e-4251-863a-9b10feb7d22a+10:2403:x1874715918619776:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 123us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868978.916087:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918620032 00000100:00100000:1.0:1787868978.916100:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918620032 00000100:00100000:3.0:1787868978.916115:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 175 00000100:00080000:3.0:1787868978.916389:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868978.916397:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 106 00000100:00100000:1.0:1787868978.916410:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93092d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f24169c3-92a7-4501-a36f-f9f115268206+5:2403:x1874715918620032:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787868978.916478:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93092d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f24169c3-92a7-4501-a36f-f9f115268206+5:2403:x1874715918620032:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 72us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868978.916485:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 106 00010000:00010000:2.0:1787868979.106574:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868979.602420:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868979.602496:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868979.602550:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787868979.602772:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918620160 00000100:00100000:3.0:1787868979.602788:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918620160 00000100:00100000:3.0:1787868979.602879:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918620416 00000100:00100000:3.0:1787868979.602883:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918620416 00000100:00100000:3.0:1787868979.602898:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918620288 00000100:00100000:3.0:1787868979.602901:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918620288 00000100:00100000:3.0:1787868979.602918:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1787868979.602930:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93090780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:847e79f0-919e-4251-863a-9b10feb7d22a+12:2405:x1874715918620160:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868979.602952:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868979.602990:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac2071400/0x2f11f4d3bde2e681 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3b2 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868979.603013:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868979.603084:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93090780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:847e79f0-919e-4251-863a-9b10feb7d22a+11:2405:x1874715918620160:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 157us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868979.603093:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1787868979.603115:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1787868979.603121:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:847e79f0-919e-4251-863a-9b10feb7d22a+10:2405:x1874715918620416:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868979.603130:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868979.603139:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871e00/0x2f11f4d3bde2e6c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff422 expref: 10 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868979.603148:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868979.603240:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:847e79f0-919e-4251-863a-9b10feb7d22a+9:2405:x1874715918620416:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 119us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868979.603281:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1787868979.603296:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:3.0:1787868979.603304:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:847e79f0-919e-4251-863a-9b10feb7d22a+8:2405:x1874715918620288:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787868979.603313:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787868979.603322:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac2070a00/0x2f11f4d3bde2e688 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff3e3 expref: 8 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868979.603334:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787868979.603353:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:847e79f0-919e-4251-863a-9b10feb7d22a+7:2405:x1874715918620288:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 51us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868979.603360:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:1.0:1787868979.621828:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868979.622146:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918620672 00000100:00100000:2.0:1787868979.622271:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918620672 00000100:00100000:2.0:1787868979.622358:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 78 00000100:00100000:2.0:1787868979.622371:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+6:2402:x1874715918620672:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:2.0:1787868979.622428:0:17088:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e696 00000020:00010000:2.0:1787868979.622442:0:17088:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93dab6e75000: total 0 00000100:00080000:2.0:1787868979.622449:0:17088:0:(import.c:65:import_set_state_nolock()) ffff93d9882f5800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787868979.622602:0:17088:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:2.0:1787868979.622822:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f24169c3-92a7-4501-a36f-f9f115268206+5:2402:x1874715918620672:12345-192.168.204.27@tcp:39:umount.0 Request processed in 451us (1086us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1787868979.622832:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 78 00000020:00010000:0.0:1787868979.623640:0:17076:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93dab6e75000: total 0 00010000:00010000:0.0:1787868979.623713:0:17076:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93dab6e75000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787868979.623808:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93daafdb5900) 00010000:00010000:0.0:1787868979.623813:0:17076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787868979.623828:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2e78b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff44c expref: 4 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868979.623855:0:17076:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93dab6e75000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787868979.623868:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868979.623870:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868979.623872:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868979.638772:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787868979.638862:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918620800 00000100:00100000:0.0:1787868979.638882:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918620800 00000100:00100000:0.0:1787868979.638966:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:0.0:1787868979.638979:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+5:2402:x1874715918620800:12345-192.168.204.27@tcp:39:umount.0 00000020:00000080:0.0:1787868979.639037:0:17090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e69d 00000100:00080000:0.0:1787868979.639052:0:17090:0:(import.c:65:import_set_state_nolock()) ffff93d988918000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787868979.639116:0:17090:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:2.0:1787868979.639315:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868979.639637:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f24169c3-92a7-4501-a36f-f9f115268206+3:2402:x1874715918620800:12345-192.168.204.27@tcp:39:umount.0 Request processed in 659us (882us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787868979.639648:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 79 00000100:00100000:3.0:1787868979.671133:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787868979.672579:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918621056 00000100:00100000:2.0:1787868979.672600:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918621056 00000100:00100000:2.0:1787868979.672704:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 176 00000100:00100000:2.0:1787868979.672717:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9822f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+7:2402:x1874715918621056:12345-192.168.204.27@tcp:251:umount.0 00000020:00000080:2.0:1787868979.672798:0:17082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e634 00000020:00010000:2.0:1787868979.672808:0:17082:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93dab523e000: total 0 00000100:00080000:2.0:1787868979.672815:0:17082:0:(import.c:65:import_set_state_nolock()) ffff93dab5238800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787868979.673247:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9822f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:847e79f0-919e-4251-863a-9b10feb7d22a+3:2402:x1874715918621056:12345-192.168.204.27@tcp:251:umount.0 Request processed in 528us (2128us total) trans 0 rc 0/0 00000020:00010000:0.0:1787868979.673250:0:17077:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93dab523e000: total 0 00010000:00010000:0.0:1787868979.673256:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868979.673257:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 176 00010000:00010000:0.0:1787868979.673333:0:17077:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93dab523e000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787868979.673379:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987287a00/0x2f11f4d3bde2e63b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff33b expref: 2 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868979.673396:0:17077:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93dab523e000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787868979.673406:0:17077:0:(genops.c:885:class_export_put()) final put ffff93dab523e000/847e79f0-919e-4251-863a-9b10feb7d22a 00010000:00010000:0.0:1787868979.673428:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868979.673430:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868979.673432:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787868979.673562:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab523e000/847e79f0-919e-4251-863a-9b10feb7d22a for MGS 00000020:00000080:2.0:1787868979.673616:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab5238800 for MGS 00000100:00100000:0.0:1787868980.001603:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868980.001649:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939671936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787868980.002310:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868980.002415:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939671936 00000100:00100000:0.0:1787868980.002425:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939671936 00000100:00100000:0.0:1787868980.002490:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787868980.002503:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939671936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787868980.002547:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787868980.002602:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939671936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868980.002610:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787868980.002663:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939671936:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787868980.002981:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787868980.003282:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939672320:0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.003334:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868980.003374:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939672832:0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.003406:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868980.003424:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939673344:0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.003448:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868980.003472:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787868980.003477:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939672448:0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.003495:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868980.003509:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939672960:0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.003525:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868980.003561:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939673472:0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.003582:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868980.003613:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939672320 00000100:00100000:3.0:1787868980.003618:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939672320 00000100:00100000:3.0:1787868980.003659:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787868980.003667:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939672320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.003713:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939672320:12345-0@lo:400:kworker.0 Request processed in 47us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868980.003719:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787868980.003741:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939672832 00000100:00100000:3.0:1787868980.003744:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939672832 00000100:00100000:3.0:1787868980.003780:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939672448 00000100:00100000:3.0:1787868980.003784:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939672448 00000100:00100000:3.0:1787868980.003803:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939672960 00000100:00100000:3.0:1787868980.003805:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939672960 00000100:00100000:3.0:1787868980.003821:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787868980.003828:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939672832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.003877:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939672832:12345-0@lo:400:kworker.0 Request processed in 49us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868980.003885:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787868980.003896:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787868980.003902:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd851e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939672448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.003923:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd851e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939672448:12345-0@lo:400:kworker.0 Request processed in 23us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868980.003928:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787868980.003937:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787868980.003942:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd850f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939672960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.003981:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd850f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939672960:12345-0@lo:400:kworker.0 Request processed in 38us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868980.003987:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787868980.004009:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939673344 00000100:00100000:3.0:1787868980.004013:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939673344 00000100:00100000:3.0:1787868980.004041:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939673472 00000100:00100000:3.0:1787868980.004044:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939673472 00000100:00100000:3.0:1787868980.004062:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787868980.004069:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd8530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939673344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.004099:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd8530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939673344:12345-0@lo:400:kworker.0 Request processed in 30us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868980.004104:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787868980.004114:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787868980.004120:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd850780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939673472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.004146:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd850780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939673472:12345-0@lo:400:kworker.0 Request processed in 27us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868980.004152:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1787868980.004254:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787868980.004258:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787868980.004260:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787868980.004262:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787868980.004297:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939672448:0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.004310:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939672960:0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.004321:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939673472:0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.004330:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939672320:0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.004352:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939672832:0@lo:400:kworker.0 00010000:00080000:3.0:1787868980.004366:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9888c1680 x1874715939673344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868980.004378:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939673344:0@lo:400:kworker.0 00000100:00100000:0.0:1787868980.007038:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939672064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868980.007690:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939672192:0@lo:400:kworker.0 00000100:00100000:2.0:1787868980.007796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868980.007885:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939672704:0@lo:400:kworker.0 00000100:00100000:2.0:1787868980.007921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868980.007945:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939673216:0@lo:400:kworker.0 00000100:00100000:2.0:1787868980.007974:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868980.008091:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939672192 00000100:00100000:1.0:1787868980.008103:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939672192 00000100:00100000:1.0:1787868980.008213:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787868980.008226:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da84238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:3639:x1874715939672192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868980.008328:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da84238850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:431a2c34-804b-46dd-9d1f-913354b6c612+24:3639:x1874715939672192:12345-0@lo:400:kworker.0 Request processed in 105us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868980.008337:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787868980.008401:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939672192:0@lo:400:kworker.0 00000100:00100000:1.0:1787868980.008448:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939673216 00000100:00100000:1.0:1787868980.008452:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939673216 00000100:00100000:1.0:1787868980.008508:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787868980.008517:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939673216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787868980.008559:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939673216:12345-0@lo:400:kworker.0 Request processed in 44us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868980.008566:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1787868980.008584:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787868980.008615:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939673216:0@lo:400:kworker.0 00000100:00100000:0.0:1787868980.009437:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868980.009584:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939672704 00000100:00100000:3.0:1787868980.009594:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939672704 00000100:00100000:3.0:1787868980.009639:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787868980.009648:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939672704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868980.009716:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939672704:12345-0@lo:400:kworker.0 Request processed in 71us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868980.009724:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787868980.009820:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939672576:0@lo:400:kworker.0 00000100:00100000:0.0:1787868980.009856:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868980.009885:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939673088:0@lo:400:kworker.0 00000100:00100000:0.0:1787868980.009914:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868980.009937:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939673600:0@lo:400:kworker.0 00000100:00100000:0.0:1787868980.009974:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868980.010015:0:20428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939672576 00000100:00100000:0.0:1787868980.010018:0:20428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939672576 00000100:00100000:0.0:1787868980.010049:0:20428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939673088 00000100:00100000:0.0:1787868980.010052:0:20428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939673088 00000100:00100000:0.0:1787868980.010076:0:20428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939673600 00000100:00100000:0.0:1787868980.010079:0:20428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939673600 00000100:00100000:0.0:1787868980.010117:0:20428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787868980.010126:0:20428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939672576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868980.010213:0:20428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939672576:12345-0@lo:400:kworker.0 Request processed in 89us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868980.010220:0:20428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787868980.010236:0:20428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787868980.010242:0:20428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939673088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868980.010282:0:20428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939673088:12345-0@lo:400:kworker.0 Request processed in 41us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868980.010288:0:20428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787868980.010298:0:20428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787868980.010304:0:20428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93369e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939673600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787868980.010327:0:20428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93369e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939673600:12345-0@lo:400:kworker.0 Request processed in 24us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868980.010353:0:20428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787868980.010399:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939672576:0@lo:400:kworker.0 00000100:00100000:0.0:1787868980.010411:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939673088:0@lo:400:kworker.0 00010000:00080000:0.0:1787868980.010425:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7fbc780 x1874715939673600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787868996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868980.010435:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939673600:0@lo:400:kworker.0 00000100:00080000:1.0:1787868980.010984:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787868980.011035:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939672704:0@lo:400:kworker.0 00000100:00100000:2.0:1787868980.016725:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939672064 00000100:00100000:2.0:1787868980.016751:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939672064 00000100:00100000:2.0:1787868980.016845:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787868980.016858:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939672064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787868980.016895:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787868980.017027:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939672064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 171us (7595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868980.017035:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787868980.017239:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939672064:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787868980.134632:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868981.153320:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787868981.631068:0:20662:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787868981.640494:0:20662:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787868981.640586:0:20662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.640604:0:20662:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.640613:0:20662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.640622:0:20662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.640650:0:20662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787868981.640657:0:20662:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787868981.640692:0:20662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787868981.640715:0:20662:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787868981.640722:0:20662:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787868981.640755:0:20662:0:(import.c:65:import_set_state_nolock()) ffff93da88304800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787868981.642280:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787868981.642298:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.642312:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286200 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868981.642317:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.642328:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868981.642337:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868981.642343:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787868981.642346:0:17077:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787868981.642350:0:17077:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787868981.642404:0:17077:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.642429:0:17077:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868981.642473:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.642481:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d987286200/0x2f11f4d3bde2e1f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e1fe expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.642498:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868981.642500:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868981.642502:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868981.642531:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939673728:0@lo:39:umount.0 00000100:00100000:0.0:1787868981.642634:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868981.642706:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787868981.642717:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939673856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868981.642754:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868981.642807:0:20428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939673728 00000100:00100000:0.0:1787868981.642816:0:20428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939673728 00000100:00100000:0.0:1787868981.642880:0:20428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787868981.642890:0:20428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874715939673728:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787868981.642927:0:20428:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e228 00000100:00080000:0.0:1787868981.642938:0:20428:0:(import.c:65:import_set_state_nolock()) ffff93dab5b26000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787868981.643006:0:20428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3635:x1874715939673728:12345-0@lo:39:umount.0 Request processed in 116us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868981.643014:0:20428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:0.0:1787868981.643025:0:20428:0:(genops.c:885:class_export_put()) final put ffff93da82b4d000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1787868981.643057:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939673856 00000100:00100000:0.0:1787868981.643060:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939673856 00000100:00100000:0.0:1787868981.643130:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787868981.643148:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:431a2c34-804b-46dd-9d1f-913354b6c612+24:3638:x1874715939673856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868981.643200:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868981.643224:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987287c00/0x2f11f4d3bde2e1fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e1f7 expref: 24 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.643240:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868981.643270:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:431a2c34-804b-46dd-9d1f-913354b6c612+23:3638:x1874715939673856:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868981.643277:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787868981.643336:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787868981.643351:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93da82b4d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787868981.643416:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab5b26000 for lustre-MDT0000 00000100:00100000:0.0:1787868981.643462:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939673856:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787868981.643503:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da88304800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787868981.643514:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd852580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939673728:0@lo:39:umount.0 00000100:00080000:3.0:1787868981.643840:0:20662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787868981.643846:0:20662:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787868981.643852:0:20662:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787868981.644960:0:20662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.644983:0:20662:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.644991:0:20662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.644998:0:20662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.645033:0:20662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868981.645040:0:20662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.645047:0:20662:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.645053:0:20662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.645059:0:20662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.645091:0:20662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787868981.645100:0:20662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.645106:0:20662:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.645113:0:20662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.645118:0:20662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.645126:0:20662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787868981.645142:0:20662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.645147:0:20662:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.645151:0:20662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.645186:0:20662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868981.645194:0:20662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1787868981.645199:0:20662:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787868981.645245:0:20662:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787868981.645251:0:20662:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787868981.645258:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787868981.645267:0:20662:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1787868981.645278:0:20662:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93daa02dc000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787868981.645285:0:20662:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93d986fa6000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787868981.645289:0:20662:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93dab6e73800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787868981.645293:0:20662:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93d98891a800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787868981.645301:0:20662:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff93dab6e75000 f24169c3-92a7-4501-a36f-f9f115268206 192.168.204.27@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1787868981.645307:0:20662:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff93dab523a000 3b83fde6-fad6-4b0f-a839-62ce511e8e7d 192.168.204.27@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:3.0:1787868981.645313:0:20662:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff93d988021a48) has exports, disconnecting them 00000020:00080000:3.0:1787868981.645319:0:20662:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93daa02dc000), last request at 1787868980 00000020:00000080:3.0:1787868981.645328:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e52a 00000100:00080000:3.0:1787868981.645352:0:20662:0:(import.c:65:import_set_state_nolock()) ffff93d981c08800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787868981.645422:0:20662:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93daa02dc000): rc 0 00000020:00000080:3.0:1787868981.645425:0:20662:0:(genops.c:885:class_export_put()) final put ffff93daa02dc000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787868981.645436:0:20662:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93d986fa6000), last request at 1787868980 00000020:00000080:3.0:1787868981.645440:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e3c5 00000100:00080000:3.0:1787868981.645445:0:20662:0:(import.c:65:import_set_state_nolock()) ffff93d986fa5000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787868981.645453:0:20662:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d986fa6000): rc 0 00000020:00000080:3.0:1787868981.645455:0:20662:0:(genops.c:885:class_export_put()) final put ffff93d986fa6000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1787868981.645459:0:20662:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93dab6e73800), last request at 1787868895 00000020:00000080:3.0:1787868981.645463:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e316 00000100:00080000:3.0:1787868981.645467:0:20662:0:(import.c:65:import_set_state_nolock()) ffff93dab6e76000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787868981.645473:0:20662:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93dab6e73800): rc 0 00000020:00000080:3.0:1787868981.645475:0:20662:0:(genops.c:885:class_export_put()) final put ffff93dab6e73800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1787868981.645485:0:20662:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93d98891a800), last request at 1787868895 00000020:00000080:3.0:1787868981.645489:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e2bb 00000100:00080000:3.0:1787868981.645493:0:20662:0:(import.c:65:import_set_state_nolock()) ffff93dab6e76800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787868981.645502:0:20662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00080000:3.0:1787868981.645606:0:20662:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d98891a800): rc 0 00000004:00000080:3.0:1787868981.645614:0:20662:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa3fe456e3ae0 00000100:00080000:3.0:1787868981.645639:0:20662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787868981.645643:0:20662:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787868981.646582:0:20662:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787868981.646621:0:20662:0:(import.c:65:import_set_state_nolock()) ffff93dab7f72800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:0.0:1787868981.646956:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa02dc000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787868981.647037:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986fa6000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787868981.647125:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6e73800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787868981.647188:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d981c08800 for lustre-MDT0000 00000020:00000080:0.0:1787868981.647193:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d986fa5000 for lustre-MDT0000 00000020:00000080:0.0:1787868981.647197:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab6e76000 for lustre-MDT0000 00010000:00010000:0.0:1787868981.647213:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787868981.647223:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647358:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287800 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868981.647385:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647396:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868981.647406:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868981.647413:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787868981.647416:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1787868981.647421:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1787868981.647463:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647470:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868981.647511:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647520:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d987287800/0x2f11f4d3bde2e148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e14f expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647535:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787868981.647540:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647546:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828c600 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868981.647549:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647556:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868981.647570:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868981.647576:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787868981.647578:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787868981.647580:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787868981.647602:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647609:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787868981.647617:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647624:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d98828c600/0x2f11f4d3bde2e55b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e562 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647639:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787868981.647643:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647650:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1c200 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787868981.647653:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647662:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787868981.647669:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787868981.647686:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787868981.647689:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787868981.647693:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787868981.647694:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868981.647713:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647714:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647744:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868981.647758:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93da80031e00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868981.647764:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647771:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868981.647778:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647782:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93daace1c200/0x2f11f4d3bde2e6ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e706 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868981.647821:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.647825:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868981.647830:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868981.647832:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868981.647862:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939674112:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1787868981.647863:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787868981.647876:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787868981.647880:0:17842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787868981.647941:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868981.647949:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868981.647971:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868981.647979:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da80031e00/0x2f11f4d3bde2e13a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e141 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787868981.647987:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787868981.648016:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868981.648019:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868981.648026:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868981.651498:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:431a2c34-804b-46dd-9d1f-913354b6c612:3637:1874715939674240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868981.651638:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868981.651743:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939674496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868981.651769:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868981.652414:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868981.652424:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939674368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868981.652460:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868981.652512:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939674112 00000100:00100000:0.0:1787868981.652522:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939674112 00000100:00100000:0.0:1787868981.652609:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939674240 00000100:00100000:0.0:1787868981.652613:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939674240 00000100:00100000:0.0:1787868981.652628:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939674496 00000100:00100000:0.0:1787868981.652631:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939674496 00000100:00100000:0.0:1787868981.652645:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939674368 00000100:00100000:0.0:1787868981.652648:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939674368 00000100:00100000:0.0:1787868981.652665:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787868981.652675:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da933683c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:431a2c34-804b-46dd-9d1f-913354b6c612+26:3636:x1874715939674112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868981.652695:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868981.652723:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d98828d600/0x2f11f4d3bde2e14f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e148 expref: 26 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.652746:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868981.652790:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da933683c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:431a2c34-804b-46dd-9d1f-913354b6c612+25:3636:x1874715939674112:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (4809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868981.652799:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787868981.652824:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787868981.652830:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93093c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:431a2c34-804b-46dd-9d1f-913354b6c612+24:3637:x1874715939674240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868981.652837:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868981.652847:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987287600/0x2f11f4d3bde2e562 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e55b expref: 24 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.652858:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868981.652884:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93093c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:431a2c34-804b-46dd-9d1f-913354b6c612+23:3637:x1874715939674240:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868981.652890:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787868981.652903:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787868981.652908:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da930930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:431a2c34-804b-46dd-9d1f-913354b6c612+22:3639:x1874715939674496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868981.652925:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868981.652936:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d98828dc00/0x2f11f4d3bde2e141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e13a expref: 22 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.652944:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868981.652970:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da930930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:431a2c34-804b-46dd-9d1f-913354b6c612+21:3639:x1874715939674496:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868981.652977:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787868981.652990:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787868981.652996:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93091e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:431a2c34-804b-46dd-9d1f-913354b6c612+20:3639:x1874715939674368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787868981.653004:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787868981.653013:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2e706 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e6ff expref: 20 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868981.653022:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787868981.653044:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93091e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:431a2c34-804b-46dd-9d1f-913354b6c612+19:3639:x1874715939674368:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868981.653051:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787868981.655615:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939674112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787868981.655684:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868981.661885:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939674368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868981.661905:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:431a2c34-804b-46dd-9d1f-913354b6c612:3639:1874715939674496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868981.661959:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:431a2c34-804b-46dd-9d1f-913354b6c612:3637:1874715939674240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868981.662528:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd850b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939673984:0@lo:39:umount.0 00000100:00100000:0.0:1787868981.662635:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868981.662707:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939673984 00000100:00100000:0.0:1787868981.662717:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939673984 00000100:00100000:0.0:1787868981.662785:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787868981.662796:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93090780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874715939673984:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787868981.662848:0:17094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e340 00000100:00080000:0.0:1787868981.662860:0:17094:0:(import.c:65:import_set_state_nolock()) ffff93daad06b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787868981.662891:0:17094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787868981.663066:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93090780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3635:x1874715939673984:12345-0@lo:39:umount.0 Request processed in 271us (430us total) trans 8589934595 rc 0/0 00000100:00080000:3.0:1787868981.664489:0:20662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787868981.664498:0:20662:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1787868981.664571:0:20662:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787868981.664640:0:20662:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787868981.664751:0:20662:0:(import.c:65:import_set_state_nolock()) ffff93dab7ed8000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787868981.664772:0:20662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787868981.664776:0:20662:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1787868981.664792:0:20662:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787868981.664858:0:20662:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787868981.664870:0:20662:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787868981.665127:0:20662:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93d988021a48) has no exports 00000100:00100000:0.0:1787868981.667914:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787868981.667941:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939674624:0@lo:9:umount.0 00000100:00100000:1.0:1787868981.668057:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868981.668117:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939674624 00000100:00100000:1.0:1787868981.668117:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd8512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939674752:0@lo:9:umount.0 00000100:00100000:3.0:1787868981.668129:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939674624 00000100:00100000:1.0:1787868981.668185:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787868981.668245:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7f72800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787868981.668254:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd850b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939673984:0@lo:39:umount.0 00000100:00100000:3.0:1787868981.668300:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939674752 00000100:00100000:3.0:1787868981.668305:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939674752 00010000:00010000:1.0:1787868981.668309:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868981.668339:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787868981.668348:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787868981.668355:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874715939674624:12345-0@lo:9:umount.0 00000100:00100000:1.0:1787868981.668363:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874715939674752:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787868981.668400:0:18596:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e40b 00000020:00000080:1.0:1787868981.668400:0:18597:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e569 00000100:00080000:1.0:1787868981.668414:0:18597:0:(import.c:65:import_set_state_nolock()) ffff93da862da800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1787868981.668415:0:18596:0:(import.c:65:import_set_state_nolock()) ffff93d987e8f800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787868981.669248:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787868981.669284:0:18596:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000001:00000004:1.0:1787868981.669382:0:18597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787868981.669577:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3635:x1874715939674624:12345-0@lo:9:umount.0 Request processed in 1225us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868981.669589:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1787868981.669635:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787868981.669659:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7ed8000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787868981.669746:0:3635:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:1.0:1787868981.669913:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3635:x1874715939674752:12345-0@lo:9:umount.0 Request processed in 1553us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868981.669921:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1787868981.673031:0:3635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787868981.673059:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939674624:0@lo:9:umount.0 00000100:00080000:0.0:1787868981.673153:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6f68000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787868981.673209:0:3635:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787868981.673212:0:3635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787868981.673216:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd8512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939674752:0@lo:9:umount.0 00000020:00080000:3.0:1787868981.678716:0:20662:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93d988021a48) has no exports 00000020:00000080:3.0:1787868981.755970:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e195 00000020:00000080:3.0:1787868981.755987:0:20662:0:(genops.c:885:class_export_put()) final put ffff93d987eaa800/lustre-QMT0000_UUID 00000020:01000000:3.0:1787868981.756053:0:20662:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787868981.756645:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868981.756659:0:20662:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787868981.756664:0:20662:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff93d9863d3490) has no exports 00000020:00000080:2.0:1787868981.757101:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e18e 00000020:00000080:2.0:1787868981.757109:0:20662:0:(genops.c:885:class_export_put()) final put ffff93d987ead800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787868981.757190:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d987eaa800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787868981.757718:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d987ead800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787868981.757801:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787868981.757814:0:20662:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787868981.757818:0:20662:0:(genops.c:885:class_export_put()) final put ffff93d987ea8800/lustre-QMT0000_UUID 00000020:00000080:3.0:1787868981.757821:0:20662:0:(genops.c:844:class_export_destroy()) destroying export ffff93d987ea8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787868981.757831:0:20662:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:1.0:1787868982.051221:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939674880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787868982.051310:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868982.051502:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939674880 00000100:00100000:0.0:1787868982.051511:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939674880 00000100:00100000:0.0:1787868982.051588:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787868982.051601:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939674880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787868982.051646:0:18598:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787868982.051707:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939674880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787868982.051715:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787868982.052720:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787868982.052777:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939674880:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787868982.177480:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868983.073605:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787868983.073643:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939675008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787868983.075833:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868983.075932:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939675008 00000100:00100000:1.0:1787868983.075950:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939675008 00000100:00100000:1.0:1787868983.076010:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787868983.076018:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874715939675008:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1787868983.076028:0:17093:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787868983.076150:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874715939675008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (332us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787868983.076185:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:02020000:2.0:1787868983.076411:0:3636:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000001:00100000:0.0:1787868983.081484:0:17822:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787868983.081511:0:17822:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1787868983.081520:0:17822:0:(genops.c:885:class_export_put()) final put ffff93daaced9000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787868983.081552:0:17822:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f24169c3-92a7-4501-a36f-f9f115268206 00000001:00080000:0.0:1787868983.081580:0:17822:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1787868983.081582:0:17822:0:(genops.c:885:class_export_put()) final put ffff93d98891b800/f24169c3-92a7-4501-a36f-f9f115268206 00000001:00100000:0.0:1787868983.081588:0:17822:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3b83fde6-fad6-4b0f-a839-62ce511e8e7d 00000001:00080000:0.0:1787868983.081595:0:17822:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1787868983.081597:0:17822:0:(genops.c:885:class_export_put()) final put ffff93dab5238000/3b83fde6-fad6-4b0f-a839-62ce511e8e7d 00000020:00000080:1.0:1787868983.084712:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93daaced9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1787868983.084802:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d98891b800/f24169c3-92a7-4501-a36f-f9f115268206 for lustre-MDT0001 00000020:00000080:1.0:1787868983.084828:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab5238000/3b83fde6-fad6-4b0f-a839-62ce511e8e7d for lustre-MDT0001 00000020:00000080:1.0:1787868983.084868:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93daad06b800 for lustre-MDT0001 00000020:00000080:1.0:1787868983.084874:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d988918000 for lustre-MDT0001 00000020:00000080:1.0:1787868983.084878:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab523c000 for lustre-MDT0001 00000100:00080000:2.0:1787868983.086413:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787868983.086422:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93da88346800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787868983.086441:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000001:00100000:0.0:1787868983.086929:0:18591:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787868983.086940:0:18591:0:(genops.c:885:class_export_put()) final put ffff93d987e88800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787868983.087621:0:17068:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787868983.087631:0:17068:0:(genops.c:885:class_export_put()) final put ffff93d98891a800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787868983.087649:0:17068:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f24169c3-92a7-4501-a36f-f9f115268206 00000001:00080000:3.0:1787868983.087660:0:17068:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:3.0:1787868983.087664:0:17068:0:(genops.c:885:class_export_put()) final put ffff93dab6e75000/f24169c3-92a7-4501-a36f-f9f115268206 00000001:00100000:0.0:1787868983.087674:0:18591:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3b83fde6-fad6-4b0f-a839-62ce511e8e7d 00000001:00100000:3.0:1787868983.087677:0:17068:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3b83fde6-fad6-4b0f-a839-62ce511e8e7d 00000020:00000080:0.0:1787868983.087683:0:18591:0:(genops.c:885:class_export_put()) final put ffff93d981c0c800/3b83fde6-fad6-4b0f-a839-62ce511e8e7d 00000001:00080000:3.0:1787868983.087687:0:17068:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:3.0:1787868983.087692:0:17068:0:(genops.c:885:class_export_put()) final put ffff93dab523a000/3b83fde6-fad6-4b0f-a839-62ce511e8e7d 00000020:00000080:1.0:1787868983.087869:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d987e88800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787868983.087940:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d98891a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787868983.088012:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6e75000/f24169c3-92a7-4501-a36f-f9f115268206 for lustre-MDT0000 00000020:00000080:1.0:1787868983.088045:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab523a000/3b83fde6-fad6-4b0f-a839-62ce511e8e7d for lustre-MDT0000 00000020:00000080:1.0:1787868983.088092:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d981c0c800/3b83fde6-fad6-4b0f-a839-62ce511e8e7d for lustre-OST0000 00000020:00000080:1.0:1787868983.088132:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d987e8f800 for lustre-OST0000 00000020:00000080:1.0:1787868983.088139:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab6e76800 for lustre-MDT0000 00000020:00000080:1.0:1787868983.088142:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d9882f5800 for lustre-MDT0000 00000020:00000080:1.0:1787868983.088147:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab523a800 for lustre-MDT0000 00000020:00000080:1.0:1787868983.088196:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d981c0d000 for lustre-OST0000 00000100:00080000:2.0:1787868983.097737:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93da88346800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868983.097753:0:3636:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1787868983.097765:0:3636:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93da88346800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787868983.097813:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab7f5b840 x1874715939675136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787868983.098000:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939675136:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787868983.098077:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868983.098383:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939675136 00000100:00100000:1.0:1787868983.098392:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939675136 00000100:00100000:1.0:1787868983.098433:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787868983.098442:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1874715939675136:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787868983.098458:0:17093:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787868983.102521:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1874715939675136:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 4074us (4437us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787868983.102537:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1787868983.102657:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da88346800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787868983.102663:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787868983.102668:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939675136:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1787868983.201505:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787868983.777739:0:20662:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93da8f984660 - data ffff93daafb47360/ffff93d981d4c000 00000020:01000000:3.0:1787868983.777942:0:20662:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93da82b46cc0 - data ffff93daafb82e58/ffff93da862d5800 00000001:00000004:3.0:1787868983.788304:0:20662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:2.0:1787868983.850468:0:20662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787868983.850479:0:20662:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787868983.850495:0:20662:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff93dabd850b40 x1874715939673984/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787868991 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868983.850524:0:20662:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787868983.852913:0:20662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787868983.852922:0:20662:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1787868983.852935:0:20662:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787868983.852938:0:20662:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787868983.854509:0:17112:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787868983.854517:0:17112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1787868983.854530:0:17112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787868983.855471:0:20662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787868983.855477:0:20662:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1787868983.855492:0:20662:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787868983.855495:0:20662:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787868983.857109:0:17114:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787868983.857118:0:17114:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1787868983.857130:0:17114:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787868983.861454:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e15d 00000020:00000080:2.0:1787868983.861468:0:20662:0:(genops.c:885:class_export_put()) final put ffff93daafd66000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787868983.863056:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93daafd66000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787868983.863501:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e172 00000020:00000080:2.0:1787868983.863511:0:20662:0:(genops.c:885:class_export_put()) final put ffff93daafd65800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787868983.863562:0:20662:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787868983.863567:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868983.863575:0:20662:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787868983.863579:0:20662:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff93d988020000) has no exports 00000004:01000000:2.0:1787868983.863748:0:20662:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787868983.863757:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e1d4 00000020:00000080:2.0:1787868983.863773:0:20662:0:(genops.c:885:class_export_put()) final put ffff93daafd62800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787868983.864747:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93daafd65800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787868983.871016:0:20662:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787868983.871056:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868983.871069:0:20662:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787868983.871074:0:20662:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff93d986e48000) has no exports 00000020:00000080:2.0:1787868983.871084:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e1cd 00000020:00000080:2.0:1787868983.871103:0:20662:0:(genops.c:885:class_export_put()) final put ffff93dab6f6c000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787868983.871513:0:20662:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787868983.871518:0:20662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787868983.871522:0:20662:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1787868983.871528:0:20662:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787868983.871531:0:20662:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787868983.871566:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787868983.871571:0:20662:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787868983.871577:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e1bf 00000020:00000080:2.0:1787868983.871581:0:20662:0:(genops.c:885:class_export_put()) final put ffff93dab6f6f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787868983.871585:0:20662:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787868983.871588:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868983.871591:0:20662:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787868983.871593:0:20662:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff93d986e49a48) has no exports 00000020:00000080:2.0:1787868983.871597:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e1b8 00000020:00000080:2.0:1787868983.871600:0:20662:0:(genops.c:885:class_export_put()) final put ffff93dab7edd800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787868983.871905:0:20662:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787868983.871908:0:20662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787868983.871911:0:20662:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1787868983.871914:0:20662:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787868983.871915:0:20662:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787868983.871935:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787868983.871939:0:20662:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1787868983.871951:0:20662:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787868983.871956:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e1aa 00000020:00000080:2.0:1787868983.871960:0:20662:0:(genops.c:885:class_export_put()) final put ffff93daa072e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787868983.871973:0:20662:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787868983.871975:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787868983.871978:0:20662:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787868983.871981:0:20662:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff93d9863d4ed8) has no exports 00000020:00000080:2.0:1787868983.871984:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e1a3 00000020:00000080:2.0:1787868983.871987:0:20662:0:(genops.c:885:class_export_put()) final put ffff93dab7f77000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787868983.872846:0:20662:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787868983.872851:0:20662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787868983.872854:0:20662:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787868983.872859:0:20662:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787868983.872892:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868983.872899:0:20662:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787868983.872920:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868983.872924:0:20662:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787868983.872928:0:20662:0:(genops.c:885:class_export_put()) final put ffff93daafd61800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787868983.872931:0:20662:0:(genops.c:844:class_export_destroy()) destroying export ffff93daafd61800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787868983.872950:0:20662:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787868983.873064:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e179 00000020:00000080:0.0:1787868983.873069:0:20662:0:(genops.c:885:class_export_put()) final put ffff93daafd64000/lustre-MDD0000_UUID 00000020:01000000:0.0:1787868983.873074:0:20662:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787868983.873077:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787868983.873080:0:20662:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787868983.873083:0:20662:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff93dabd2fb490) has no exports 00000020:00000080:0.0:1787868983.873115:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868983.873119:0:20662:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787868983.873123:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e180 00000020:00000080:0.0:1787868983.873127:0:20662:0:(genops.c:885:class_export_put()) final put ffff93daafd64800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787868983.873135:0:20662:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93daa05e9800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787868983.873139:0:20662:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93daa05e9800 3 00000020:01000004:0.0:1787868983.873142:0:20662:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93daa05e9800 from lustre-MDT0000 00000020:00000080:0.0:1787868983.873178:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868983.873182:0:20662:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787868983.873185:0:20662:0:(genops.c:885:class_export_put()) final put ffff93daafd60800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787868983.873187:0:20662:0:(genops.c:844:class_export_destroy()) destroying export ffff93daafd60800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787868983.873194:0:20662:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787868983.873226:0:20662:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787868983.873229:0:20662:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787868983.873232:0:20662:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787868983.873235:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787868983.873237:0:20662:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787868983.873244:0:20662:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff93daa7e3c000 431a2c34-804b-46dd-9d1f-913354b6c612 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787868983.873249:0:20662:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff93d988023490) has exports, disconnecting them 00000020:00080000:0.0:1787868983.873254:0:20662:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93daa7e3c000), last request at 1787868879 00000020:00000080:0.0:1787868983.873267:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e125 00000020:00010000:0.0:1787868983.873270:0:20662:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93daa7e3c000: total 8 00000100:00080000:0.0:1787868983.873274:0:20662:0:(import.c:65:import_set_state_nolock()) ffff93daa7e3d800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787868983.873292:0:20662:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93daa7e3c000): rc 0 00000020:00080000:0.0:1787868983.873301:0:20662:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff93d988023490) has no exports 00000100:00100000:0.0:1787868983.873377:0:17081:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff93dab6f5de00:17081] 0 exiting: rc = 1 00000020:00010000:0.0:1787868983.873453:0:17077:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93daa7e3c000: total 8 00010000:00010000:0.0:1787868983.873475:0:17077:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93daa7e3c000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787868983.873505:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d98828c400/0x2f11f4d3bde2e244 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e23d expref: 14 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868983.873526:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93daace1c400/0x2f11f4d3bde2e6dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e6d5 expref: 13 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868983.873537:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987286400/0x2f11f4d3bde2e301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e2fa expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868983.873547:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987286a00/0x2f11f4d3bde2e252 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e24b expref: 11 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868983.873557:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93daace1d800/0x2f11f4d3bde2e6ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e6e3 expref: 10 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868983.873566:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d987287200/0x2f11f4d3bde2e260 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e259 expref: 9 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868983.873575:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d98828ca00/0x2f11f4d3bde2e133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e12c expref: 8 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868983.873585:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93da80030e00/0x2f11f4d3bde2e3b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e3a9 expref: 7 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868983.873596:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871800/0x2f11f4d3bde2e4eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e4e4 expref: 6 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868983.873605:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd870a00/0x2f11f4d3bde2e6f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e6f1 expref: 5 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868983.873623:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd870000/0x2f11f4d3bde2e515 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e50e expref: 4 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868983.873633:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dac2070e00/0x2f11f4d3bde2e554 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e54d expref: 3 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868983.873645:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d98828c000/0x2f11f4d3bde2e386 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2f11f4d3bde2e37f expref: 2 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787868983.873655:0:17077:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93daa7e3c000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787868983.873666:0:17077:0:(genops.c:885:class_export_put()) final put ffff93daa7e3c000/431a2c34-804b-46dd-9d1f-913354b6c612 00010000:00010000:0.0:1787868983.873671:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868983.873673:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868983.873674:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868983.873784:0:17083:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff93da82e07e00:17083] 2 exiting: rc = 0 00000020:00000080:1.0:1787868983.873833:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93daafd62800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787868983.873847:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6f6c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787868983.873853:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab6f68000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787868983.873858:0:8:0:(genops.c:885:class_export_put()) final put ffff93dab6f6e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787868983.873862:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6f6e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787868983.873865:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787868983.873916:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6f6f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787868983.873921:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7edd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787868983.873925:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab7ed8000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787868983.873928:0:8:0:(genops.c:885:class_export_put()) final put ffff93daa072f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787868983.873930:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa072f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787868983.873933:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787868983.873954:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa072e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787868983.873958:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7f77000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787868983.873962:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab7f72800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787868983.873966:0:8:0:(genops.c:885:class_export_put()) final put ffff93dab7ed9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787868983.873968:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7ed9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787868983.873973:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787868983.873996:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93daafd64000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787868983.873999:0:8:0:(genops.c:885:class_export_put()) final put ffff93daafd60000/lustre-MDD0000_UUID 00000020:00000080:1.0:1787868983.874002:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93daafd60000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787868983.874005:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787868983.874028:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93daafd64800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787868983.874032:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa7e3c000/431a2c34-804b-46dd-9d1f-913354b6c612 for MGS 00000020:00000080:1.0:1787868983.874056:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93daa7e3d800 for MGS 00000100:00100000:2.0:1787868983.927743:0:17082:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff93da99da7600:17082] 1 exiting: rc = 0 00000100:00100000:0.0:1787868983.927949:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.927958:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.927964:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.927970:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.927977:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.927983:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.927989:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.927995:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928001:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928007:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928014:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928021:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928026:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928031:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928036:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928042:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928048:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928066:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928072:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928078:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928083:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928098:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928104:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928110:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928115:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928121:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928126:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928130:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928135:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928140:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928144:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928149:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928187:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928194:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928199:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928204:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928209:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928215:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928220:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928225:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928230:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928235:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928240:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928246:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928251:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928256:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928261:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928266:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928271:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928276:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928281:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928286:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928299:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928304:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928310:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928315:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928320:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928325:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928329:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928335:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928339:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928344:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928349:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868983.928354:0:20662:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787868983.929584:0:20662:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93da8f9846c0 - data ffff93daa0bd20d8/ffff93d981d4d000 00000020:01000000:0.0:1787868983.929708:0:20662:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93d9810b3e40 - data ffff93daa0809000/ffff93da84269800 00000020:00000080:0.0:1787868983.930149:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e109 00000020:00000080:0.0:1787868983.930259:0:20662:0:(genops.c:885:class_export_put()) final put ffff93daa7e38800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787868983.930309:0:20662:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93daa05e9800 from MGS, refs=2 00000020:01000004:0.0:1787868983.930314:0:20662:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93daa05e9800 2 00000020:01000004:0.0:1787868983.930317:0:20662:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93daa05e9800 from MGS 00000020:00000080:0.0:1787868983.930339:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868983.930346:0:20662:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787868983.930348:0:20662:0:(genops.c:885:class_export_put()) final put ffff93daa7e3b000/MGS 00000020:00000080:0.0:1787868983.930351:0:20662:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa7e3b000/MGS for MGS 00000020:01000000:0.0:1787868983.930358:0:20662:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787868983.930422:0:20662:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787868983.930426:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787868983.930432:0:20662:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787868983.930440:0:20662:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93daafd67000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787868983.930445:0:20662:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff93d9863d1a48) has exports, disconnecting them 00000020:00080000:0.0:1787868983.930450:0:20662:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93daafd67000), last request at 1787868880 00000020:00000080:0.0:1787868983.930454:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e20c 00000020:00080000:0.0:1787868983.930464:0:20662:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93daafd67000): rc 0 00000020:00000080:0.0:1787868983.930479:0:20662:0:(genops.c:885:class_export_put()) final put ffff93daafd67000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787868983.930508:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa7e38800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787868983.934276:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93daafd67000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787868983.934328:0:20662:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787868983.934334:0:20662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787868983.934338:0:20662:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787868983.934344:0:20662:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787868983.934364:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93da88304800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787868983.934506:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868983.934515:0:20662:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787868983.934521:0:20662:0:(genops.c:885:class_export_put()) final put ffff93d98731f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787868983.934524:0:20662:0:(genops.c:844:class_export_destroy()) destroying export ffff93d98731f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787868983.934529:0:20662:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787868983.934611:0:20662:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93daa05e9800 1 00000020:00000080:1.0:1787868983.934619:0:20662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e0fb 00000020:00000080:1.0:1787868983.934624:0:20662:0:(genops.c:885:class_export_put()) final put ffff93daa05ec800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787868983.934633:0:20662:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787868983.934641:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa05ec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787868983.934649:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787868983.934654:0:20662:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787868983.934658:0:20662:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff93d988024ed8) has no exports 00000020:00000080:0.0:1787868984.095799:0:20662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868984.095813:0:20662:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787868984.095819:0:20662:0:(genops.c:885:class_export_put()) final put ffff93daa05ef000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787868984.095825:0:20662:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa05ef000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787868984.095837:0:20662:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787868984.095957:0:20662:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93daa05ef800 00000020:02000400:0.0:1787868984.096246:0:20662:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787868984.232354:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787868985.124728:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787868985.124737:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787868985.124741:0:8:0:(import.c:65:import_set_state_nolock()) ffff93da88346800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787868985.124765:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 607 00000100:00080000:3.0:1787868985.124772:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787868985.124779:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93da88346800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868985.124804:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dabd853c00 x1874715939675392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787868985.124898:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd852940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939675264:0@lo:400:kworker.0 00000400:00000100:3.0:1787868985.124953:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874715939675264 offset 0 length 224: 4 00000100:00100000:3.0:1787868985.124993:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd852d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939675904:0@lo:400:kworker.0 00000100:00100000:3.0:1787868985.125027:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868985.125115:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787868985.125122:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd853840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939675520:0@lo:400:kworker.0 00000100:00100000:3.0:1787868985.125149:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868985.125193:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd8503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939676032:0@lo:400:kworker.0 00000100:00100000:3.0:1787868985.125215:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868985.125241:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd853c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939675392:0@lo:38:kworker.0 00000100:00100000:3.0:1787868985.125267:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868985.125299:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd851a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939675648:0@lo:400:kworker.0 00000100:00100000:3.0:1787868985.125323:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868985.125341:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd851680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939676160:0@lo:400:kworker.0 00000100:00100000:3.0:1787868985.125360:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868985.125379:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787868985.125384:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd8521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939675776:0@lo:400:kworker.0 00000100:00100000:3.0:1787868985.125406:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868985.125423:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabd850b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939676288:0@lo:400:kworker.0 00000100:00100000:3.0:1787868985.125455:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868985.125493:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939675904 00000100:00100000:3.0:1787868985.125501:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939675904 00000100:00100000:3.0:1787868985.125535:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939676032 00000100:00100000:3.0:1787868985.125538:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939676032 00000100:00100000:3.0:1787868985.125567:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939676160 00000100:00100000:3.0:1787868985.125571:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939676160 00000100:00100000:3.0:1787868985.125578:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939675776 00000100:00100000:3.0:1787868985.125580:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939675776 00000100:00100000:3.0:1787868985.125587:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939676288 00000100:00100000:3.0:1787868985.125589:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939676288 00000100:00100000:3.0:1787868985.125605:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787868985.125614:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd852580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939676032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868985.125667:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd852580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939676032:12345-0@lo:400:kworker.0 Request processed in 54us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868985.125674:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787868985.125694:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787868985.125701:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939676288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868985.125732:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939676288:12345-0@lo:400:kworker.0 Request processed in 32us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868985.125738:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787868985.125750:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787868985.125754:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd8512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874715939675904:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787868985.125760:0:17090:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787868985.125784:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd8512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874715939675904:12345-0@lo:400:kworker.0 Request processed in 29us (757us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787868985.125790:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787868985.125800:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787868985.125811:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874715939676160:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787868985.125816:0:17090:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787868985.125838:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874715939676160:12345-0@lo:400:kworker.0 Request processed in 26us (477us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787868985.125843:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787868985.125856:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787868985.125860:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874715939675776:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787868985.125864:0:17090:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787868985.125886:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874715939675776:12345-0@lo:400:kworker.0 Request processed in 25us (480us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787868985.125891:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787868985.125908:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939675520 00000100:00100000:3.0:1787868985.125911:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939675520 00000100:00100000:3.0:1787868985.125935:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939675648 00000100:00100000:3.0:1787868985.125938:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939675648 00000100:00100000:3.0:1787868985.125954:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787868985.125960:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabd850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939675520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868985.125988:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabd850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939675520:12345-0@lo:400:kworker.0 Request processed in 29us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868985.125994:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787868985.126004:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787868985.126009:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939675648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787868985.126035:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939675648:12345-0@lo:400:kworker.0 Request processed in 25us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868985.126039:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787868985.126059:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939675392 00000100:00100000:3.0:1787868985.126062:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939675392 00000100:00100000:3.0:1787868985.126100:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787868985.126105:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939675392:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787868985.126123:0:17094:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1787868985.127542:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787868985.127550:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787868985.127553:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787868985.127625:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787868985.127631:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93d986fa0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787868985.127635:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787868985.133844:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787868985.133883:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939676416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787868985.133958:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868985.134246:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939676416 00000100:00100000:2.0:1787868985.134254:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939676416 00000100:00100000:2.0:1787868985.134309:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787868985.134320:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939676416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787868985.134350:0:18599:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787868985.134396:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939676416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787868985.134404:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787868985.134452:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939676416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787868985.176375:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939675392:12345-0@lo:38:kworker.0 Request processed in 50260us (51098us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787868985.176391:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1787868985.176461:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da88346800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787868985.176467:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787868985.176471:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd853c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939675392:0@lo:38:kworker.0 00000100:00100000:0.0:1787868985.185407:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd853840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939675520:0@lo:400:kworker.0 00010000:00080000:0.0:1787868985.185430:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff93dabd8503c0 x1874715939676032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868985.185442:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd8503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939676032:0@lo:400:kworker.0 00000100:00080000:0.0:1787868985.185454:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787868985.185459:0:3638:0:(import.c:65:import_set_state_nolock()) ffff93dab5b21000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787868985.185463:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787868985.185468:0:3638:0:(import.c:65:import_set_state_nolock()) ffff93dab5b21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787868985.185473:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 535 00000100:00080000:0.0:1787868985.185483:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93dab5b21000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787868985.185519:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab6f54780 x1874715939676544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787868985.185544:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd852d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939675904:0@lo:400:kworker.0 00000100:00100000:3.0:1787868985.195209:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1874715939676544:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787868985.195290:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787868985.195416:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939676544 00000100:00100000:0.0:1787868985.195425:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939676544 00000100:00100000:0.0:1787868985.195474:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787868985.195483:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1874715939676544:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1787868985.195514:0:17090:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787868985.195559:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1874715939676544:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 76us (269us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787868985.195567:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1787868985.195646:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab5b21000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787868985.195651:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787868985.195655:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1874715939676544:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1787868985.218627:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93d986fa0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787868985.218644:0:3636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 519 00000100:00080000:1.0:1787868985.218654:0:3636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d986fa0000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868985.218918:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dabed092c0 x1874715939676672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787868985.218946:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd8521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939675776:0@lo:400:kworker.0 00000100:00100000:1.0:1787868985.218963:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874715939676672:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787868985.219850:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868985.219926:0:20429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939676672 00000100:00100000:1.0:1787868985.219935:0:20429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939676672 00000100:00100000:1.0:1787868985.219978:0:20429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787868985.219986:0:20429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3635:x1874715939676672:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1787868985.220021:0:20429:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787868985.220080:0:20429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3635:x1874715939676672:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 94us (232us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787868985.220089:0:20429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787868985.220138:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d986fa0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787868985.220143:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787868985.220146:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874715939676672:0@lo:38:ptlrpcd_00_00.0 00010000:00080000:1.0:1787868985.220276:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff93dabd850b40 x1874715939676288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787868985.220288:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd850b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939676288:0@lo:400:kworker.0 00000100:00100000:1.0:1787868985.220301:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd851a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939675648:0@lo:400:kworker.0 00000100:00080000:1.0:1787868985.220313:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787868985.220316:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93d987e8b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787868985.220319:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787868985.220331:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93d987e8b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787868985.220335:0:3636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 552 00000100:00080000:1.0:1787868985.220340:0:3636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d987e8b000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787868985.220360:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dabed092c0 x1874715939676800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787868985.220379:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd851680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939676160:0@lo:400:kworker.0 00000100:00100000:1.0:1787868985.220389:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939676800:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787868985.220417:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868985.220445:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939676800 00000100:00100000:1.0:1787868985.220449:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939676800 00000100:00100000:1.0:1787868985.220473:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787868985.220478:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874715939676800:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1787868985.220489:0:17088:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787868985.220520:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874715939676800:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 41us (102us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787868985.220526:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1787868985.220546:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d987e8b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787868985.220550:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787868985.220552:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939676800:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1787868985.257486:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868986.276341:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868987.169635:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939676928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787868987.169746:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868987.169905:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939676928 00000100:00100000:3.0:1787868987.169914:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939676928 00000100:00100000:3.0:1787868987.170002:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787868987.170012:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939676928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787868987.170050:0:18599:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787868987.170107:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939676928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787868987.170115:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787868987.170304:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939676928:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787868987.170565:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787868987.306112:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787868987.695923:0:19410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787868987.695939:0:19410:0:(genops.c:885:class_export_put()) final put ffff93da862db800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787868987.697475:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93da862db800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787868987.700504:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93da862da800 for lustre-OST0001 00000040:00080000:2.0:1787868988.001925:0:17843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787868988.322486:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787868988.736114:0:20863:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787868988.743387:0:20863:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1787868988.743439:0:20863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.743474:0:20863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.743484:0:20863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.743562:0:20863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.743585:0:20863:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787868988.743591:0:20863:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1787868988.743620:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868988.743626:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.743634:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287000 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868988.743638:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.743647:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868988.743656:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868988.743674:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787868988.743677:0:17077:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787868988.743679:0:17077:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787868988.743717:0:17077:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.743724:0:17077:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787868988.743746:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.743753:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d987287000/0x2f11f4d3bde2e2fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e301 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.743765:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868988.743767:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868988.743769:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787868988.743792:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939677056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868988.743863:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787868988.743982:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939677056 00000100:00100000:3.0:1787868988.743989:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939677056 00000100:00100000:1.0:1787868988.744050:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787868988.744058:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3636:x1874715939677056:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787868988.744066:0:17073:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787868988 with bad export cookie 3391761184647733541 00000100:00080000:3.0:1787868988.745378:0:20863:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787868988.745384:0:20863:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787868988.745391:0:20863:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787868988.745397:0:20863:0:(import.c:65:import_set_state_nolock()) ffff93d986fa0000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787868988.745403:0:20863:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787868988.745405:0:20863:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787868988.745407:0:20863:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787868988.748676:0:20863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.748715:0:20863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.748724:0:20863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.748731:0:20863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.748769:0:20863:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868988.748776:0:20863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.748783:0:20863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.748788:0:20863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.748794:0:20863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868988.748797:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868988.748806:0:20863:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787868988.751632:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868988.751700:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0200 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868988.751713:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868988.751732:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868988.751740:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868988.751747:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787868988.751750:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1787868988.751801:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868988.751808:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787868988.751884:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:431a2c34-804b-46dd-9d1f-913354b6c612:3637:1874715939677184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787868988.751969:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787868988.752058:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868988.752067:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0200/0x2f11f4d3bde2e259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e260 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868988.752084:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787868988.752088:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868988.752095:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828d000 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:2.0:1787868988.752109:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868988.752128:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787868988.752135:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787868988.752140:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787868988.752142:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787868988.752144:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787868988.752179:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868988.752185:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787868988.752203:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868988.752209:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d98828d000/0x2f11f4d3bde2e54d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e554 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868988.752223:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868988.752225:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787868988.752226:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868988.752401:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939677312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868988.752451:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787868988.752596:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868988.752614:0:20863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752623:0:20863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752637:0:20863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752643:0:20863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752660:0:20863:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787868988.752670:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868988.752674:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752680:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1400 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868988.752683:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752690:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868988.752696:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868988.752701:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787868988.752703:0:17077:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787868988.752705:0:17077:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787868988.752726:0:17077:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752731:0:17077:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787868988.752738:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752749:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1400/0x2f11f4d3bde2e6f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e6f8 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752759:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868988.752760:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868988.752761:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868988.752772:0:20863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752778:0:20863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752783:0:20863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752789:0:20863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752800:0:20863:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787868988.752804:0:20863:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1787868988.752806:0:20863:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:3.0:1787868988.752839:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868988.752843:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752850:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1e00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868988.752853:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752870:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868988.752875:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868988.752879:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787868988.752881:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787868988.752883:0:17842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787868988.752897:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.752902:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787868988.752937:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787868988.752945:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939677440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868988.752974:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868988.753022:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939677184 00000100:00100000:2.0:1787868988.753029:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939677184 00000100:00100000:2.0:1787868988.753064:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939677312 00000100:00100000:2.0:1787868988.753067:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939677312 00000100:00100000:2.0:1787868988.753076:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939677440 00000100:00100000:2.0:1787868988.753078:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939677440 00000100:00100000:2.0:1787868988.753090:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787868988.753098:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1874715939677184:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787868988.753105:0:17075:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787868988 with bad export cookie 3391761184647733541 00010000:00010000:3.0:1787868988.756717:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.756732:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1e00/0x2f11f4d3bde2e24b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2f11f4d3bde2e252 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868988.756758:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868988.756760:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868988.756763:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787868988.756813:0:20863:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1787868988.756818:0:20863:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1787868988.756826:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787868988.756831:0:20863:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787868988.756840:0:20863:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff93d981c09000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787868988.756847:0:20863:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff93d987fb2800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787868988.756852:0:20863:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff93dabd848000) has exports, disconnecting them 00000020:00080000:3.0:1787868988.756872:0:20863:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93d981c09000), last request at 1787868985 00000020:00000080:3.0:1787868988.756880:0:20863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e53f 00000100:00080000:3.0:1787868988.756900:0:20863:0:(import.c:65:import_set_state_nolock()) ffff93d981c0f000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787868988.756950:0:20863:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d981c09000): rc 0 00000020:00000080:3.0:1787868988.756953:0:20863:0:(genops.c:885:class_export_put()) final put ffff93d981c09000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1787868988.756969:0:20863:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93d987fb2800), last request at 1787868985 00000020:00000080:3.0:1787868988.756973:0:20863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e3da 00000100:00080000:3.0:1787868988.756978:0:20863:0:(import.c:65:import_set_state_nolock()) ffff93d987fb0000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787868988.756990:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787868988.757010:0:20863:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d987fb2800): rc 0 00000020:00000080:3.0:1787868988.757012:0:20863:0:(genops.c:885:class_export_put()) final put ffff93d987fb2800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1787868988.757020:0:20863:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa3fe4199fae0 00000100:00080000:3.0:1787868988.757056:0:20863:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787868988.757066:0:20863:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff93dab7fbc780 x1874715939675008/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787868999 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787868988.757078:0:20863:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1787868988.757697:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1874715939677184:12345-0@lo:103:ldlm_bl.0 Request processed in 4595us (5724us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787868988.757711:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:00000080:2.0:1787868988.757743:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d981c09000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1787868988.757790:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d987fb2800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1787868988.757811:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d981c0f000 for lustre-MDT0001 00000020:00000080:2.0:1787868988.757816:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d987fb0000 for lustre-MDT0001 00000100:00100000:2.0:1787868988.757837:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787868988.757843:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1874715939677312:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787868988.757850:0:18622:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787868988 with bad export cookie 3391761184647733541 00000100:00100000:2.0:1787868988.757923:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1874715939677312:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (5472us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787868988.757930:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787868988.757945:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787868988.757950:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f58780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1874715939677440:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787868988.757955:0:18622:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787868988 with bad export cookie 3391761184647733541 00000100:00100000:2.0:1787868988.757982:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f58780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1874715939677440:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (5007us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787868988.757988:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787868988.758031:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939677568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868988.758080:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787868988.758116:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939675008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787868988.758151:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939677568 00000100:00100000:2.0:1787868988.758174:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939677568 00000100:00100000:2.0:1787868988.758197:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787868988.758202:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3636:x1874715939677568:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787868988.758206:0:18622:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787868988 with bad export cookie 3391761184647733541 00000100:00100000:2.0:1787868988.758237:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3636:x1874715939677568:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (156us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787868988.758243:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787868988.758270:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787868988.758274:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93d989103000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787868988.758278:0:3636:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787868988.758954:0:20863:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787868988.758961:0:20863:0:(import.c:65:import_set_state_nolock()) ffff93da88346800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:1.0:1787868988.760859:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3636:x1874715939677056:12345-0@lo:103:ldlm_bl.0 Request processed in 16794us (16990us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787868988.760889:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787868988.761075:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787868988.762107:0:20863:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787868988.762112:0:20863:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1787868988.762133:0:20863:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787868988.762219:0:20863:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787868988.762254:0:20863:0:(import.c:65:import_set_state_nolock()) ffff93dab6e72000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787868988.762277:0:20863:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787868988.762280:0:20863:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1787868988.762291:0:20863:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787868988.762351:0:20863:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787868988.762361:0:20863:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecf800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787868988.762416:0:20863:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff93dabd848000) has no exports 00010000:00010000:3.0:1787868988.763232:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787868988.763870:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939677696:0@lo:9:umount.0 00000100:00100000:1.0:1787868988.763976:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868988.764027:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939677824:0@lo:9:umount.0 00000100:00100000:1.0:1787868988.764047:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787868988.764218:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939677696 00000100:00100000:1.0:1787868988.764226:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939677696 00000100:00100000:1.0:1787868988.764276:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939677824 00000100:00100000:1.0:1787868988.764279:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939677824 00000100:00100000:1.0:1787868988.764307:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787868988.764314:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874715939677696:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787868988.764339:0:18594:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e404 00000100:00080000:1.0:1787868988.764348:0:18594:0:(import.c:65:import_set_state_nolock()) ffff93d987e8c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787868988.764386:0:18594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1787868988.764558:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3635:x1874715939677696:12345-0@lo:9:umount.0 Request processed in 243us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868988.764566:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787868988.764583:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787868988.764590:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874715939677824:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787868988.764602:0:18594:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e570 00000100:00080000:1.0:1787868988.764608:0:18594:0:(import.c:65:import_set_state_nolock()) ffff93da862dc800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787868988.764629:0:18594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1787868988.764703:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3635:x1874715939677824:12345-0@lo:9:umount.0 Request processed in 113us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787868988.764710:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1787868988.764736:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868988.764755:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787868988.764785:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab6e72000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787868988.764798:0:3635:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787868988.764800:0:3635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787868988.764804:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939677696:0@lo:9:umount.0 00000100:00080000:1.0:1787868988.764817:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab7ecf800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787868988.764820:0:3635:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787868988.764822:0:3635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787868988.764824:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939677824:0@lo:9:umount.0 00000100:00080000:3.0:1787868988.766285:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787868988.770415:0:3636:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.127@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787868988.770421:0:3636:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787868988.770429:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dabd852940 x1874715939675264/t0(0) o400->MGC192.168.204.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787869001 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868988.770443:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d9888c0780 x1874715939677056/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787869004 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868988.770454:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab7f59a40 x1874715939677184/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787869004 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868988.770475:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab7f5a1c0 x1874715939677312/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787869004 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868988.770484:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d9888c30c0 x1874715939677440/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787869004 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868988.770552:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d9888c2940 x1874715939677568/t0(0) o103->MGC192.168.204.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787869004 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787868988.770673:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787868988.770676:0:3636:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787868988.770677:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787868988.771020:0:3637:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff93d989103000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1787868988.771238:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:431a2c34-804b-46dd-9d1f-913354b6c612:3637:1874715939677184:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787868988.771347:0:3638:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff93d989103000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:2.0:1787868988.771356:0:3636:0:(import.c:65:import_set_state_nolock()) ffff93d989103000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787868988.771362:0:3636:0:(import.c:510:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 503 00000100:00100000:3.0:1787868988.771369:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939677312:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787868988.771371:0:3636:0:(import.c:624:import_select_connection()) MGC192.168.204.127@tcp: import ffff93d989103000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868988.771378:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabd852940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939675264:0@lo:400:kworker.0 00000100:00100000:3.0:1787868988.771394:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:431a2c34-804b-46dd-9d1f-913354b6c612:3638:1874715939677440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868988.771401:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab7f5a580 x1874715939677952/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787868988.771434:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939677056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787868988.771447:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:431a2c34-804b-46dd-9d1f-913354b6c612:3636:1874715939677568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787868988.771468:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:431a2c34-804b-46dd-9d1f-913354b6c612:3635:1874715939677952:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1787868988.771517:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874715939677952 offset 0 length 520: 4 00000100:00080000:2.0:1787868988.771742:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1787868988.781513:0:20863:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff93dabd848000) has no exports 00000020:01000000:2.0:1787868988.824014:0:20863:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93da8f984540 - data ffff93daa0842a20/ffff93d981d4f000 00000020:01000000:2.0:1787868988.826419:0:20863:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93daa0413d20 - data ffff93daaf9b7438/ffff93daacddb000 00000001:00000004:2.0:1787868988.840429:0:20863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1787868988.905670:0:20863:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787868988.905679:0:20863:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787868988.905688:0:20863:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787868988.910813:0:20863:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787868988.910821:0:20863:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1787868988.910895:0:20863:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787868988.910897:0:20863:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787868988.911759:0:17830:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787868988.911766:0:17830:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1787868988.911777:0:17830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1787868988.912460:0:20863:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787868988.912465:0:20863:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1787868988.912481:0:20863:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787868988.912483:0:20863:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787868988.912785:0:17832:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787868988.912790:0:17832:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1787868988.912798:0:17832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1787868988.915050:0:20863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e26e 00000020:00000080:1.0:1787868988.915062:0:20863:0:(genops.c:885:class_export_put()) final put ffff93da8362a800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787868988.916081:0:20863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e283 00000020:00000080:1.0:1787868988.916090:0:20863:0:(genops.c:885:class_export_put()) final put ffff93d9888f1000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787868988.916575:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93da8362a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1787868988.916912:0:20863:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1787868988.916919:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787868988.916928:0:20863:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787868988.916932:0:20863:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff93dabd2f8000) has no exports 00000004:01000000:1.0:1787868988.917112:0:20863:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787868988.917121:0:20863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e2d7 00000020:00000080:1.0:1787868988.917127:0:20863:0:(genops.c:885:class_export_put()) final put ffff93dab6e75800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787868988.917633:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9888f1000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1787868988.917717:0:20863:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787868988.917722:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787868988.917728:0:20863:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787868988.917731:0:20863:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff93d986e4ced8) has no exports 00000020:00000080:1.0:1787868988.917738:0:20863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e2d0 00000020:00000080:1.0:1787868988.917742:0:20863:0:(genops.c:885:class_export_put()) final put ffff93dab7ecb000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787868988.918059:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6e75800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1787868988.918723:0:20863:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787868988.918728:0:20863:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787868988.918741:0:20863:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1787868988.918748:0:20863:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787868988.918750:0:20863:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787868988.918933:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7ecb000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787868988.919390:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868988.919399:0:20863:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787868988.919406:0:20863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e2c2 00000020:00000080:1.0:1787868988.919413:0:20863:0:(genops.c:885:class_export_put()) final put ffff93d986fa4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787868988.919439:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab7ecf800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787868988.919446:0:36:0:(genops.c:885:class_export_put()) final put ffff93d98891e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787868988.919708:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93d98891e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787868988.919715:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787868988.919858:0:20863:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787868988.919864:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787868988.919869:0:20863:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787868988.919873:0:20863:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff93daaf713490) has no exports 00000020:00000080:1.0:1787868988.919878:0:20863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e2b4 00000020:00000080:3.0:1787868988.919936:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986fa4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787868988.919969:0:20863:0:(genops.c:885:class_export_put()) final put ffff93d986fa6800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787868988.920219:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986fa6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787868988.920650:0:20863:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787868988.920654:0:20863:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787868988.920659:0:20863:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1787868988.920664:0:20863:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787868988.920666:0:20863:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787868988.920738:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787868988.920744:0:20863:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787868988.920756:0:20863:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787868988.920762:0:20863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e2a6 00000020:00000080:1.0:1787868988.920768:0:20863:0:(genops.c:885:class_export_put()) final put ffff93daafd61000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787868988.921366:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab6e72000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787868988.921374:0:36:0:(genops.c:885:class_export_put()) final put ffff93da829c8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787868988.921376:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93da829c8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787868988.921381:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787868988.921582:0:20863:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1787868988.921587:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787868988.921593:0:20863:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787868988.921597:0:20863:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff93d9863d0000) has no exports 00000020:00000080:1.0:1787868988.921603:0:20863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e29f 00000020:00000080:1.0:1787868988.921608:0:20863:0:(genops.c:885:class_export_put()) final put ffff93da88342800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787868988.922038:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93daafd61000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787868988.922051:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93da88342800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787868988.924235:0:20863:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787868988.924243:0:20863:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787868988.924258:0:20863:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787868988.924265:0:20863:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787868988.924319:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868988.924329:0:20863:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787868988.924352:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868988.924355:0:20863:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787868988.924360:0:20863:0:(genops.c:885:class_export_put()) final put ffff93d986fa2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787868988.924364:0:20863:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986fa2800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787868988.924386:0:20863:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787868988.924549:0:20863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e28a 00000020:00000080:0.0:1787868988.924556:0:20863:0:(genops.c:885:class_export_put()) final put ffff93da9326c000/lustre-MDD0001_UUID 00000020:01000000:0.0:1787868988.924561:0:20863:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787868988.924565:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787868988.924569:0:20863:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787868988.924572:0:20863:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff93daaf714ed8) has no exports 00000020:00000080:0.0:1787868988.924589:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868988.924593:0:20863:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787868988.924596:0:20863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e291 00000020:00000080:0.0:1787868988.924599:0:20863:0:(genops.c:885:class_export_put()) final put ffff93da9326f800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787868988.924607:0:20863:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93dab7ec9800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787868988.924611:0:20863:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93dab7ec9800 2 00000020:01000004:0.0:1787868988.924614:0:20863:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93dab7ec9800 from lustre-MDT0001 00000020:00000080:0.0:1787868988.924630:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787868988.924632:0:20863:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787868988.924634:0:20863:0:(genops.c:885:class_export_put()) final put ffff93dab7ecd800/lustre-MDT0001_UUID 00000020:00000080:0.0:1787868988.924636:0:20863:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7ecd800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787868988.924643:0:20863:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787868988.924672:0:20863:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1787868988.924676:0:20863:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787868988.924679:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787868988.924682:0:20863:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787868988.924689:0:20863:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff93dab6e72800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787868988.924694:0:20863:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff93daaf711a48) has exports, disconnecting them 00000020:00080000:0.0:1787868988.924698:0:20863:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff93dab6e72800), last request at 1787868895 00000020:00000080:0.0:1787868988.924702:0:20863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e30f 00000020:00080000:0.0:1787868988.924714:0:20863:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93dab6e72800): rc 0 00000020:00000080:0.0:1787868988.924717:0:20863:0:(genops.c:885:class_export_put()) final put ffff93dab6e72800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787868988.925387:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93da88346800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787868988.925395:0:36:0:(genops.c:885:class_export_put()) final put ffff93daa05df800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787868988.925398:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa05df800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1787868988.925404:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787868988.925521:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93da9326c000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787868988.925525:0:36:0:(genops.c:885:class_export_put()) final put ffff93d986fa3000/lustre-MDD0001_UUID 00000020:00000080:3.0:1787868988.925527:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986fa3000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787868988.925531:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787868988.925627:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93da9326f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787868988.925632:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6e72800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1787868988.939223:0:20863:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1787868988.939233:0:20863:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787868988.939238:0:20863:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787868988.939256:0:20863:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787868988.939293:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d986fa0000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787868988.939488:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787868988.939497:0:20863:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1787868988.939503:0:20863:0:(genops.c:885:class_export_put()) final put ffff93dab6e74800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787868988.939507:0:20863:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab6e74800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787868988.939514:0:20863:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1787868988.939596:0:20863:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93dab7ec9800 1 00000020:00000080:3.0:1787868988.939603:0:20863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e236 00000020:00000080:3.0:1787868988.939609:0:20863:0:(genops.c:885:class_export_put()) final put ffff93d986fa7800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1787868988.939619:0:20863:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1787868988.939627:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986fa7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787868988.939638:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787868988.939644:0:20863:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787868988.939648:0:20863:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff93dabd84b490) has no exports 00000020:00000080:3.0:1787868988.960896:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787868988.960913:0:20863:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1787868988.960919:0:20863:0:(genops.c:885:class_export_put()) final put ffff93dab7ecd000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787868988.960924:0:20863:0:(genops.c:844:class_export_destroy()) destroying export ffff93dab7ecd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787868988.960935:0:20863:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787868988.961073:0:20863:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93dab7ec8000 00000020:01000000:3.0:1787868988.961093:0:20863:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787868988.961097:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787868988.961101:0:20863:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787868988.961105:0:20863:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff93dabd84ced8) has no exports 00000100:00100000:1.0:1787868988.961896:0:17089:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff93daaf7f6200:17089] 1 exiting: rc = 0 00000100:00100000:1.0:1787868988.962021:0:20429:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff93d981b01a00:20429] 4 exiting: rc = 0 00000100:00100000:1.0:1787868988.962215:0:20428:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff93dab527c600:20428] 3 exiting: rc = 0 00000100:00100000:1.0:1787868988.962364:0:17088:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff93daaf7f6400:17088] 0 exiting: rc = 1 00000100:00100000:1.0:1787868988.962416:0:17090:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff93daaf7f7a00:17090] 2 exiting: rc = 0 00000100:00100000:3.0:1787868988.962910:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.962919:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.962924:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.962929:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.962936:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.962941:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.962946:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.962952:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.962958:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.962963:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.962970:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.962975:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.962981:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.962987:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963006:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963021:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963026:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963032:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963038:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963043:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963049:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963054:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963060:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963065:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963071:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963077:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963084:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963101:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963108:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963113:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963118:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963123:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963128:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963135:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963140:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963147:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963153:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963182:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963188:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963194:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963200:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963205:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963213:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963218:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963223:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963228:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963233:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963238:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963244:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963392:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963408:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963413:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963418:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963423:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963428:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963434:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963439:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963445:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963461:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963466:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963471:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963477:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963482:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.963487:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787868988.968127:0:17091:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93daaf7f6e00:17091] 0 exiting: rc = 1 00000100:00100000:3.0:1787868988.968413:0:17092:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93daaf7f6800:17092] 1 exiting: rc = 0 00000100:00100000:3.0:1787868988.968533:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968542:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968549:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968556:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968561:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968566:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968571:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968577:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968583:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968588:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968594:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968599:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968603:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968608:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968613:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968619:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968624:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968629:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968634:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968639:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968657:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968662:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968668:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968673:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968679:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968684:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968690:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968696:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968701:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968706:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968712:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968717:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968721:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968726:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968731:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968735:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968741:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968745:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968750:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968754:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968759:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968763:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968768:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968773:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968778:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968783:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968789:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968794:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968800:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968805:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968810:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968815:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968821:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968826:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968832:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968845:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968851:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968856:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968861:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968866:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968872:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968877:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968882:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.968887:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969634:0:17094:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff93daa0797c00:17094] 1 exiting: rc = 0 00000100:00100000:1.0:1787868988.969778:0:17093:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff93daa0796000:17093] 0 exiting: rc = 1 00000100:00100000:3.0:1787868988.969871:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969878:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969884:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969890:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969897:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969903:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969909:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969915:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969921:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969927:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969933:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969939:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969945:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969951:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969973:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969980:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.969986:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970003:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970011:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970017:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970023:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970029:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970036:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970041:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970048:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970065:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970085:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970101:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970107:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970113:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970119:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970124:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970130:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970135:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970141:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970147:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970152:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970184:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970203:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970209:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970214:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970220:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970226:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970231:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970237:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970242:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970402:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970409:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970416:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970422:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970443:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970527:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970534:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970540:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970546:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970552:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970558:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970565:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970571:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970577:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970591:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970598:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970603:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.970610:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868988.981959:0:17096:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93dab012aa00:17096] 1 exiting: rc = 0 00000100:00100000:1.0:1787868988.982346:0:17095:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93dab012a000:17095] 0 exiting: rc = 1 00000100:00100000:3.0:1787868988.982538:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982547:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982552:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982558:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982563:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982568:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982573:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982579:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982584:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982590:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982595:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982601:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982606:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982611:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982616:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982621:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982626:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982632:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982638:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982644:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982649:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982653:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982658:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982663:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982668:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982672:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982677:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982682:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982688:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982693:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982698:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982717:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982722:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982727:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982732:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982737:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982742:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982747:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982753:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982758:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982764:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982770:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982790:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982795:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982800:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982806:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982811:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982817:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982821:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982826:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982831:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982836:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982840:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982846:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982851:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982856:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982861:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982866:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982870:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982875:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982880:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982885:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982890:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.982896:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868988.985617:0:17097:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93dab012bc00:17097] 0 exiting: rc = 1 00000100:00100000:1.0:1787868988.986001:0:17098:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93dab012a600:17098] 1 exiting: rc = 0 00000100:00100000:3.0:1787868988.986112:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986120:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986134:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986140:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986144:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986149:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986184:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986192:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986198:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986203:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986208:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986212:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986217:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986222:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986227:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986232:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986236:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986240:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986245:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986250:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986255:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986260:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986264:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986268:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986274:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986280:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986285:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986290:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986295:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986300:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986305:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986310:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986315:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986320:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986324:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986329:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986334:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986348:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986353:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986359:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986364:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986368:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986373:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986378:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986383:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986388:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986393:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986398:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986402:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986407:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986411:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986415:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986419:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986423:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986428:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986433:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986438:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986443:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986709:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986717:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986722:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986727:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986732:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.986738:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787868988.987113:0:17099:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff93dab012b000:17099] 0 exiting: rc = 1 00000100:00100000:1.0:1787868988.987316:0:17100:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff93dab012ae00:17100] 1 exiting: rc = 0 00000100:00100000:3.0:1787868988.987411:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987418:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987423:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987428:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987433:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987439:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987444:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987461:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987476:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987482:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987488:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987493:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987499:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987504:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987509:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987514:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987519:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987524:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987529:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987534:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987539:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987544:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987549:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987554:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987559:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987564:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987569:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987574:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987580:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987586:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987592:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987597:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987602:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987607:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987613:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987618:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987622:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987627:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987632:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987637:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987643:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987648:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987654:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987668:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987673:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987678:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987684:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987689:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987694:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987700:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987705:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987709:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987714:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987720:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987726:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987732:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987738:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987742:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987747:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987752:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987756:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987761:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987766:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.987771:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787868988.988780:0:17103:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff93da8ffc3600:17103] 2 exiting: rc = 0 00000100:00100000:1.0:1787868988.989007:0:17102:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff93dab6f79800:17102] 1 exiting: rc = 0 00000100:00100000:0.0:1787868988.990059:0:17101:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff93d9881d3200:17101] 0 exiting: rc = 1 00000100:00100000:3.0:1787868988.990424:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990431:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990438:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990443:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990515:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990520:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990526:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990532:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990537:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990559:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990565:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990571:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990577:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990583:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990602:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990608:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990613:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990619:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990625:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990631:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990637:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990642:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990648:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990653:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990659:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990665:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990671:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990679:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990685:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990692:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990700:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990706:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990714:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990738:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990745:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990751:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990756:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990762:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990770:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990776:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990782:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990788:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990793:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990798:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990803:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990810:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990816:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990822:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990828:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990839:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990845:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990851:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990857:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990863:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990869:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990875:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990881:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990887:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990892:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990898:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990903:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990910:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990916:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787868988.990921:0:20863:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787868988.996981:0:20863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787868988.997012:0:20863:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787868988.997022:0:20863:0:(genops.c:885:class_export_put()) final put ffff93d989103800/MDS_uuid 00000020:00000080:3.0:1787868988.997029:0:20863:0:(genops.c:844:class_export_destroy()) destroying export ffff93d989103800/MDS_uuid for MDS 00000020:01000000:3.0:1787868988.997038:0:20863:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787868988.997700:0:20863:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1787868989.347246:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787868990.241467:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) 431a2c34-804b-46dd-9d1f-913354b6c612->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787868990.241477:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) 431a2c34-804b-46dd-9d1f-913354b6c612->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787868990.241481:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787868990.241486:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787868990.241491:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93dab5b21000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787868990.241501:0:13937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 609 00000100:00080000:0.0:1787868990.241509:0:13937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787868990.241517:0:13937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93dab5b21000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787868990.241562:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab6f56d00 x1874715939678080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787868990.241617:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787868990.241621:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787868990.241622:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93d987e8b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787868990.241626:0:13937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 609 00000100:00080000:0.0:1787868990.241630:0:13937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787868990.241633:0:13937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d987e8b000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787868990.241646:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab6f57840 x1874715939678336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787868990.241692:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939678208:0@lo:400:kworker.0 00000400:00000100:0.0:1787868990.241755:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939678208 offset 0 length 224: 4 00000100:00100000:0.0:1787868990.241814:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787868990.241823:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939678464:0@lo:400:kworker.0 00000400:00000100:0.0:1787868990.241862:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939678464 offset 0 length 224: 4 00000100:00100000:3.0:1787868990.241997:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1874715939678080:0@lo:38:kworker.0 00000400:00000100:3.0:1787868990.242021:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939678080 offset 0 length 520: 4 00000100:00100000:3.0:1787868990.242034:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939678336:0@lo:38:kworker.0 00000400:00000100:3.0:1787868990.242049:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939678336 offset 0 length 520: 4 00010000:00010000:1.0:1787868990.389204:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868991.393804:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868992.417364:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787868993.193887:0:21063:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787868993.202468:0:21063:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787868993.202519:0:21063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e3b0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868993.202532:0:21063:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e3b0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868993.202539:0:21063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e3b0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868993.202546:0:21063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e3b0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787868993.202587:0:21063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787868993.202592:0:21063:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787868993.202620:0:21063:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787868993.202634:0:21063:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab6f56d00 x1874715939678080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787869005 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787868993.202714:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787868993.202721:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e3b0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868993.202729:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1200 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787868993.202733:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e3b0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868993.202749:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e3b0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787868993.202756:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e3b0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787868993.202762:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787868993.202765:0:17077:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787868993.202768:0:17077:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787868993.202783:0:17077:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d989103000 00010000:00010000:3.0:1787868993.202787:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2e3b0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868993.202794:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6fb1200/0x2f11f4d3bde2e3a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2e3b0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787868993.202808:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868993.202810:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787868993.202812:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787868993.202839:0:21063:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787868993.202848:0:21063:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787868993.202855:0:21063:0:(import.c:65:import_set_state_nolock()) ffff93dab5b21000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787868993.202861:0:21063:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787868993.202866:0:21063:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab6f56d00 x1874715939678080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787869005 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868993.202935:0:21063:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787868993.204637:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1874715939678080:0@lo:38:kworker.0 00000100:00100000:2.0:1787868993.204832:0:21063:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787868993.206025:0:21063:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787868993.206038:0:21063:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab6f54f00 x1874715939678208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869006 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787868993.206058:0:21063:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1787868993.206092:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939678208:0@lo:400:kworker.0 00000100:00080000:2.0:1787868993.206645:0:21063:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787868993.206671:0:21063:0:(import.c:65:import_set_state_nolock()) ffff93d987fb7800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787868993.206747:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1874715939678592:0@lo:39:umount.0 00000400:00000100:0.0:1787868993.206807:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939678592 offset 0 length 224: 4 00000100:00080000:2.0:1787868993.249755:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) 431a2c34-804b-46dd-9d1f-913354b6c612->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787868993.249767:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) 431a2c34-804b-46dd-9d1f-913354b6c612->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787868993.249770:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787868993.249774:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787868993.249922:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787868993.249950:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939678720:0@lo:400:kworker.0 00000400:00000100:3.0:1787868993.250006:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939678720 offset 0 length 224: 4 00010000:00010000:1.0:1787868993.441508:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868994.465388:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787868994.851481:0:18591:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787868994.851493:0:18591:0:(genops.c:885:class_export_put()) final put ffff93d987e8e800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787868994.854023:0:19410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787868994.854033:0:19410:0:(genops.c:885:class_export_put()) final put ffff93da862d8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787868994.854105:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d987e8e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787868994.854191:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d987e8c000 for lustre-OST0000 00000020:00000080:0.0:1787868994.861765:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93da862d8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787868994.861846:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93da862dc800 for lustre-OST0001 00000100:00080000:0.0:1787868995.297817:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) 431a2c34-804b-46dd-9d1f-913354b6c612->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787868995.297829:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) 431a2c34-804b-46dd-9d1f-913354b6c612->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787868995.297832:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787868995.297836:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787868995.297976:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939678848:0@lo:400:kworker.0 00000400:00000100:2.0:1787868995.298031:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939678848 offset 0 length 224: 4 00010000:00010000:3.0:1787868995.489671:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868996.513708:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787868997.538737:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787868998.306246:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868988/real 1787868988] req@ffff93dab7f5a580 x1874715939677952/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787868998 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787868998.306282:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93dab7f5a580 x1874715939677952/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787868998 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787868998.306317:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d989103000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787868998.306343:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787868998.306348:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:431a2c34-804b-46dd-9d1f-913354b6c612:3635:1874715939677952:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1787868998.307084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 431a2c34-804b-46dd-9d1f-913354b6c612->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787868998.307090:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787868998.307093:0:36:0:(import.c:65:import_set_state_nolock()) ffff93d989103000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787868998.307117:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 612 00000100:00080000:3.0:1787868998.307123:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.127@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787868998.307129:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.127@tcp: import ffff93d989103000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787868998.307187:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9888c1e00 x1874715939678976/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787868998.307214:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787868998.307218:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787868998.307324:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787868998.307340:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939679104:0@lo:400:kworker.0 00000400:00000100:2.0:1787868998.307401:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939679104 offset 0 length 224: 4 00000100:00100000:0.0:1787868998.308370:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:431a2c34-804b-46dd-9d1f-913354b6c612:3635:1874715939678976:0@lo:250:kworker.0 00000400:00000100:0.0:1787868998.308416:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874715939678976 offset 0 length 520: 4 00010000:00010000:3.0:1787868998.561413:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787868999.585377:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869000.610627:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869001.634016:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869002.657707:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787869003.425243:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868993/real 1787868993] req@ffff93dab7f59a40 x1874715939678592/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787869003 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869003.425280:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93dab7f59a40 x1874715939678592/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787869003 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787869003.425302:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d987fb7800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787869003.425325:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1874715939678592:0@lo:39:umount.0 00000100:00080000:2.0:1787869003.425409:0:21063:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787869003.425415:0:21063:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787869003.425430:0:21063:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787869003.426405:0:21063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e386 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869003.426423:0:21063:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e386 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869003.426432:0:21063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e386 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869003.426439:0:21063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e386 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869003.426468:0:21063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787869003.426475:0:21063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e6ea expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869003.426483:0:21063:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e6ea expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869003.426510:0:21063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e6ea expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869003.426515:0:21063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e6ea expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869003.426535:0:21063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787869003.426540:0:21063:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787869003.426568:0:21063:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787869003.426573:0:21063:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787869003.426578:0:21063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787869003.426584:0:21063:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787869003.426588:0:21063:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff93dabd2f9a48) has no exports 00000020:00080000:2.0:1787869003.426662:0:21063:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff93dabd2f9a48) has no exports 00010000:00010000:0.0:1787869003.428687:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787869003.428701:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e386 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869003.428724:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987286e00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787869003.428728:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e386 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869003.428739:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e386 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787869003.428746:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e386 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787869003.428753:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787869003.428755:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787869003.428759:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787869003.428778:0:17076:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d989103000 00010000:00010000:0.0:1787869003.428782:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2e386 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869003.428806:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d987286e00/0x2f11f4d3bde2e37f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2e386 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869003.428822:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869003.428826:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e6ea expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869003.428833:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0800 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787869003.428836:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e6ea expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869003.428842:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e6ea expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787869003.428849:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e6ea expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787869003.428854:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787869003.428857:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787869003.428859:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787869003.428864:0:17076:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d989103000 00010000:00010000:0.0:1787869003.428868:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2e6ea expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869003.428875:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0800/0x2f11f4d3bde2e6e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2e6ea expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869003.428883:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869003.428885:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869003.428893:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869003.430088:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787869003.436254:0:21063:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93d987fa9840 - data ffff93daaf9ebd80/ffff93dabd96a000 00000020:01000000:2.0:1787869003.436447:0:21063:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93da82b46d20 - data ffff93daafaa8288/ffff93daacf5e400 00100000:10000000:2.0:1787869003.444456:0:21063:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787869003.457359:0:21063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e394 00000020:00000080:3.0:1787869003.457373:0:21063:0:(genops.c:885:class_export_put()) final put ffff93daa0729000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787869003.457453:0:21063:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93da82b4f800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787869003.457457:0:21063:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93da82b4f800 2 00000020:01000004:3.0:1787869003.457460:0:21063:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93da82b4f800 from lustre-OST0000 00000020:00000080:3.0:1787869003.457498:0:21063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787869003.457509:0:21063:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787869003.457512:0:21063:0:(genops.c:885:class_export_put()) final put ffff93daacedd800/lustre-OST0000_UUID 00000020:00000080:3.0:1787869003.457515:0:21063:0:(genops.c:844:class_export_destroy()) destroying export ffff93daacedd800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787869003.457522:0:21063:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787869003.457577:0:21063:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787869003.457582:0:21063:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787869003.457586:0:21063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787869003.457591:0:21063:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787869003.457598:0:21063:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93d986fa7000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787869003.457604:0:21063:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff93d987f80000) has exports, disconnecting them 00000020:00080000:3.0:1787869003.457609:0:21063:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93d986fa7000), last request at 1787868911 00000020:00000080:3.0:1787869003.457612:0:21063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e3be 00000020:00080000:3.0:1787869003.457633:0:21063:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d986fa7000): rc 0 00000020:00000080:3.0:1787869003.457638:0:21063:0:(genops.c:885:class_export_put()) final put ffff93d986fa7000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787869003.460293:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa0729000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787869003.467185:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986fa7000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787869003.497228:0:21063:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787869003.497238:0:21063:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787869003.497243:0:21063:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787869003.497251:0:21063:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787869003.497454:0:21063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787869003.497465:0:21063:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787869003.497471:0:21063:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787869003.497480:0:21063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787869003.497485:0:21063:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787869003.497492:0:21063:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff93d987fb3800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787869003.497499:0:21063:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff93d987f81a48) has exports, disconnecting them 00000020:00080000:0.0:1787869003.497503:0:21063:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff93d987fb3800), last request at 1787868911 00000020:00000080:0.0:1787869003.497508:0:21063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e3d3 00000020:00080000:0.0:1787869003.497524:0:21063:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d987fb3800): rc 0 00000020:00000080:0.0:1787869003.497530:0:21063:0:(genops.c:885:class_export_put()) final put ffff93d987fb3800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787869003.498439:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93dab5b21000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787869003.498449:0:13937:0:(genops.c:885:class_export_put()) final put ffff93d988919000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787869003.498452:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d988919000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787869003.498465:0:13937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787869003.498524:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d987fb3800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787869003.498548:0:21063:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787869003.498552:0:21063:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787869003.498554:0:21063:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787869003.498560:0:21063:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787869003.498575:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d987fb7800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787869003.498741:0:21063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787869003.498758:0:21063:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787869003.498761:0:21063:0:(genops.c:885:class_export_put()) final put ffff93d986fa1800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787869003.498764:0:21063:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986fa1800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787869003.498769:0:21063:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787869003.498794:0:21063:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93da82b4f800 1 00000020:00000080:1.0:1787869003.498799:0:21063:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e371 00000020:00000080:1.0:1787869003.498804:0:21063:0:(genops.c:885:class_export_put()) final put ffff93daad080000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787869003.498812:0:21063:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787869003.498819:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93daad080000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787869003.498828:0:21063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787869003.498831:0:21063:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787869003.498834:0:21063:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff93daaf710000) has no exports 00000100:00080000:3.0:1787869003.631825:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) 431a2c34-804b-46dd-9d1f-913354b6c612->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787869003.631838:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) 431a2c34-804b-46dd-9d1f-913354b6c612->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787869003.631841:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787869003.631845:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787869003.632857:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939679232:0@lo:400:kworker.0 00000400:00000100:1.0:1787869003.633031:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939679232 offset 0 length 224: 4 00000020:00000080:0.0:1787869003.637915:0:21063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787869003.637932:0:21063:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787869003.637940:0:21063:0:(genops.c:885:class_export_put()) final put ffff93daa7e39800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787869003.637945:0:21063:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa7e39800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787869003.637960:0:21063:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787869003.638492:0:21063:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93da82b49000 00000020:02000400:0.0:1787869003.638544:0:21063:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787869003.690960:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869004.710262:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787869005.473300:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868990/real 1787868990] req@ffff93dab6f57840 x1874715939678336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787869005 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869005.473337:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93dab6f57840 x1874715939678336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787869005 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787869005.473359:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d987e8b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787869005.473450:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787869005.473455:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939678336:0@lo:38:kworker.0 00000100:00080000:2.0:1787869005.475216:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) 431a2c34-804b-46dd-9d1f-913354b6c612->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787869005.475226:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) 431a2c34-804b-46dd-9d1f-913354b6c612->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787869005.475229:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787869005.475233:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787869005.475237:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93d987e8b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787869005.475245:0:13937:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 614 00000100:00080000:2.0:1787869005.475250:0:13937:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787869005.475258:0:13937:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d987e8b000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787869005.475300:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab7f5a1c0 x1874715939679360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787869005.475384:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939679360:0@lo:38:kworker.0 00000400:00000100:0.0:1787869005.475451:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939679360 offset 0 length 520: 4 00000100:00100000:1.0:1787869005.475795:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939679488:0@lo:400:kworker.0 00000400:00000100:1.0:1787869005.475822:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939679488 offset 0 length 224: 4 00010000:00010000:3.0:1787869005.733402:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1787869006.498853:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787868990/real 1787868990] req@ffff93dab6f54000 x1874715939678464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787869006 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787869006.552382:0:3639:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff93dab6f54000 x1874715939678464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787869006 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787869006.552397:0:3639:0:(import.c:65:import_set_state_nolock()) ffff93d981c0c000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787869006.552401:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787869006.568818:0:3639:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1787869006.568882:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 431a2c34-804b-46dd-9d1f-913354b6c612->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787869006.568893:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 431a2c34-804b-46dd-9d1f-913354b6c612->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787869006.568898:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787869006.568902:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787869006.568905:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787869006.568916:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787869006.568922:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d981c0c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787869006.568934:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 552 00000100:00080000:2.0:1787869006.568946:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93d981c0c000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787869006.569016:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab7f5b840 x1874715939679616/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787869006.569253:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939678464:0@lo:400:kworker.0 00000100:00100000:3.0:1787869006.569332:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1874715939679616:0@lo:38:kworker.0 00000400:00000100:3.0:1787869006.569413:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874715939679616 offset 0 length 520: 4 00010000:00010000:3.0:1787869006.763456:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869007.777377:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787869008.018276:0:21266:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787869008.044475:0:21266:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787869008.044598:0:21266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e515 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869008.044615:0:21266:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e515 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869008.044639:0:21266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e515 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869008.044648:0:21266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e515 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869008.044679:0:21266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787869008.044699:0:21266:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787869008.044738:0:21266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787869008.044750:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab7f5a1c0 x1874715939679360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787869025 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787869008.044900:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869008.044908:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e515 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869008.044916:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287e00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787869008.044920:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e515 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869008.044929:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e515 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787869008.044937:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e515 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869008.044943:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787869008.044947:0:17077:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787869008.044955:0:17077:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787869008.044971:0:17077:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d989103000 00010000:00010000:3.0:1787869008.044976:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2e515 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869008.044983:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93d987287e00/0x2f11f4d3bde2e50e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2e515 expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869008.044993:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869008.044995:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869008.044997:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869008.045379:0:21266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787869008.045388:0:21266:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787869008.045395:0:21266:0:(import.c:65:import_set_state_nolock()) ffff93d987e8b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787869008.045400:0:21266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787869008.045406:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab7f5a1c0 x1874715939679360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787869025 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869008.051409:0:21266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787869008.055358:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939679360:0@lo:38:kworker.0 00000100:00100000:2.0:1787869008.055557:0:21266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787869008.059002:0:21266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787869008.059020:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab7f5b0c0 x1874715939678720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869009 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869008.059271:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab6f56d00 x1874715939678848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869011 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869008.059285:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d9888c3c00 x1874715939679104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869014 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869008.059292:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d9888c12c0 x1874715939679232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869019 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869008.059300:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab7f58f00 x1874715939679488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869021 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869008.059323:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab7f5b840 x1874715939679616/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787869016 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869008.059333:0:21266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787869008.059339:0:21266:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787869008.059362:0:21266:0:(import.c:65:import_set_state_nolock()) ffff93d981c0c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787869008.059367:0:21266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787869008.059372:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab7f5b0c0 x1874715939678720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869009 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869008.059434:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939679488:0@lo:400:kworker.0 00000100:00100000:0.0:1787869008.059494:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939679104:0@lo:400:kworker.0 00000100:00100000:1.0:1787869008.061131:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939678720:0@lo:400:kworker.0 00000100:00100000:2.0:1787869008.061310:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab6f56d00 x1874715939678848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869011 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869008.061324:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d9888c3c00 x1874715939679104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869014 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869008.061331:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d9888c12c0 x1874715939679232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869019 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869008.061339:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab7f58f00 x1874715939679488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869021 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869008.061347:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93dab7f5b840 x1874715939679616/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787869016 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869008.061354:0:21266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787869008.061522:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939678848:0@lo:400:kworker.0 00000100:00100000:0.0:1787869008.061654:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1874715939679616:0@lo:38:kworker.0 00000100:00100000:1.0:1787869008.062002:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939679232:0@lo:400:kworker.0 00000100:00100000:2.0:1787869008.062038:0:21266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787869008.064084:0:21266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e4eb expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869008.064259:0:21266:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e4eb expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869008.064267:0:21266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e4eb expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869008.064274:0:21266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e4eb expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869008.064361:0:21266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787869008.064370:0:21266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2e6dc expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869008.064376:0:21266:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2e6dc expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869008.064381:0:21266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e6dc expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869008.064388:0:21266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2f11f4d3bde2e6dc expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869008.064480:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787869008.064488:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e4eb expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869008.064496:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dac2071c00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787869008.064499:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e4eb expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869008.064508:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e4eb expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787869008.064515:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e4eb expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869008.064521:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787869008.064524:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1787869008.064535:0:17842:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d989103000 00010000:00010000:3.0:1787869008.064540:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2e4eb expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869008.064554:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dac2071c00/0x2f11f4d3bde2e4e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2e4eb expref: -99 pid: 19409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869008.064585:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869008.064589:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e6dc expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869008.064594:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870e00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:3.0:1787869008.064597:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2f11f4d3bde2e6dc expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869008.064603:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e6dc expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787869008.064609:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e6dc expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869008.064613:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787869008.064616:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1787869008.064631:0:17842:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d989103000 00010000:00010000:3.0:1787869008.064634:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2e6dc expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869008.064641:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869008.064643:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869008.064645:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869008.064994:0:21266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787869008.064999:0:21266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2e6d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2e6dc expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787869008.065013:0:21266:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1787869008.065019:0:21266:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1787869008.065021:0:21266:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787869008.065050:0:21266:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787869008.065054:0:21266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787869008.065059:0:21266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787869008.065064:0:21266:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787869008.065068:0:21266:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff93d986e4b490) has no exports 00000020:00080000:2.0:1787869008.065103:0:21266:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff93d986e4b490) has no exports 00000020:01000000:2.0:1787869008.068485:0:21266:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93d988baf780 - data ffff93daaf9a2af8/ffff93d981c46800 00000020:01000000:2.0:1787869008.068988:0:21266:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93daacca3540 - data ffff93daafb42360/ffff93daace86400 00010000:00010000:3.0:1787869008.069380:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787869008.094277:0:21266:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787869008.102583:0:21266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e4f9 00000020:00000080:2.0:1787869008.102605:0:21266:0:(genops.c:885:class_export_put()) final put ffff93d987066000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787869008.102640:0:21266:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d9871e8000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787869008.102645:0:21266:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d9871e8000 2 00000020:01000004:2.0:1787869008.102649:0:21266:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d9871e8000 from lustre-OST0001 00000020:00000080:0.0:1787869008.102653:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d987066000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787869008.102681:0:21266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787869008.102692:0:21266:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787869008.102695:0:21266:0:(genops.c:885:class_export_put()) final put ffff93d987061800/lustre-OST0001_UUID 00000020:00000080:2.0:1787869008.102697:0:21266:0:(genops.c:844:class_export_destroy()) destroying export ffff93d987061800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787869008.102704:0:21266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787869008.103367:0:21266:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 431a2c34-804b-46dd-9d1f-913354b6c612->MGS 00010000:00010000:2.0:1787869008.103387:0:21266:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0600/0x2f11f4d3bde2e23d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e244 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787869008.103399:0:21266:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0600/0x2f11f4d3bde2e23d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e244 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787869008.103405:0:21266:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787869008.103408:0:21266:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787869008.103411:0:21266:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787869008.103426:0:21266:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d989103000 00010000:00010000:2.0:1787869008.103429:0:21266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6fb0600/0x2f11f4d3bde2e23d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2e244 expref: -99 pid: 17821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869008.103442:0:21266:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787869008.103447:0:21266:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787869008.103451:0:21266:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787869008.103453:0:21266:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787869008.103455:0:21266:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787869008.103474:0:21266:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d989103000 00010000:00010000:2.0:1787869008.103478:0:21266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93da80031000/0x2f11f4d3bde2e12c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2f11f4d3bde2e133 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787869008.103495:0:21266:0:(import.c:65:import_set_state_nolock()) ffff93d989103000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787869008.103499:0:21266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787869008.103507:0:21266:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787869008.103509:0:21266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787869008.103513:0:21266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787869008.103524:0:21266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d9888c1e00 x1874715939678976/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787869013 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787869008.103536:0:21266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787869008.103538:0:21266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:0.0:1787869008.103586:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:431a2c34-804b-46dd-9d1f-913354b6c612:3635:1874715939678976:0@lo:250:kworker.0 10000000:01000000:2.0:1787869008.103810:0:21266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787869008.103817:0:21266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e117 00000020:00000080:2.0:1787869008.103822:0:21266:0:(genops.c:885:class_export_put()) final put ffff93d989107800/431a2c34-804b-46dd-9d1f-913354b6c612 00000020:01000000:2.0:1787869008.103839:0:21266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.127@tcp (flags='') 00000020:00000080:2.0:1787869008.103845:0:21266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787869008.103850:0:21266:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.127@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787869008.103854:0:21266:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff93dabd849a48) has no exports 00000020:00000080:0.0:1787869008.103863:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d989107800/431a2c34-804b-46dd-9d1f-913354b6c612 for MGC192.168.204.127@tcp 10000000:01000000:1.0:1787869008.103919:0:17085:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787869008.104007:0:21266:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.127@tcp: client import never connected 00000100:00080000:2.0:1787869008.104011:0:21266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787869008.104013:0:21266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787869008.104016:0:21266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787869008.104018:0:21266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787869008.104061:0:21266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787869008.104067:0:21266:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.127@tcp (uuid 431a2c34-804b-46dd-9d1f-913354b6c612) 00000020:01000000:2.0:1787869008.104073:0:21266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787869008.104077:0:21266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787869008.104081:0:21266:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787869008.104098:0:21266:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93daa02da000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787869008.104104:0:21266:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff93dabc0b8000) has exports, disconnecting them 00000020:00080000:2.0:1787869008.104116:0:21266:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93daa02da000), last request at 1787868928 00000020:00000080:2.0:1787869008.104121:0:21266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e523 00000020:00080000:2.0:1787869008.104132:0:21266:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93daa02da000): rc 0 00000020:00000080:2.0:1787869008.104137:0:21266:0:(genops.c:885:class_export_put()) final put ffff93daa02da000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787869008.105215:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d989103000 for MGC192.168.204.127@tcp 00000020:00000080:0.0:1787869008.105227:0:13937:0:(genops.c:885:class_export_put()) final put ffff93d989100800/431a2c34-804b-46dd-9d1f-913354b6c612 00000020:00000080:0.0:1787869008.105229:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d989100800/431a2c34-804b-46dd-9d1f-913354b6c612 for MGC192.168.204.127@tcp 00000020:01000000:0.0:1787869008.105236:0:13937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.127@tcp (431a2c34-804b-46dd-9d1f-913354b6c612) 00000020:00000080:0.0:1787869008.105541:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93daa02da000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787869008.107268:0:21266:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787869008.107279:0:21266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787869008.107284:0:21266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787869008.107291:0:21266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787869008.107490:0:21266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787869008.107500:0:21266:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787869008.107508:0:21266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787869008.107525:0:21266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787869008.107530:0:21266:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787869008.107539:0:21266:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff93d981c0d800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787869008.107546:0:21266:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff93dabc0b9a48) has exports, disconnecting them 00000020:00080000:0.0:1787869008.107550:0:21266:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff93d981c0d800), last request at 1787868928 00000020:00000080:0.0:1787869008.107554:0:21266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e538 00000020:00080000:0.0:1787869008.107574:0:21266:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d981c0d800): rc 0 00000020:00000080:0.0:1787869008.107580:0:21266:0:(genops.c:885:class_export_put()) final put ffff93d981c0d800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1787869008.108296:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d987e8b000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787869008.108306:0:13937:0:(genops.c:885:class_export_put()) final put ffff93d987063800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787869008.108308:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d987063800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787869008.108320:0:13937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787869008.108383:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93d981c0d800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1787869008.109551:0:21266:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787869008.109558:0:21266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787869008.109562:0:21266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787869008.109568:0:21266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787869008.109597:0:13937:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d981c0c000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1787869008.112235:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787869008.116223:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787869008.123282:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1787869008.123550:0:17071:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93da8a92aa00:17071] 0 exiting: rc = 1 00000100:00100000:0.0:1787869008.127015:0:17072:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93da8a92b600:17072] 1 exiting: rc = 0 00000100:00100000:1.0:1787869008.127307:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.128039:0:17074:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93dabeea8800:17074] 1 exiting: rc = 0 00000100:00100000:2.0:1787869008.128131:0:18622:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93d988843000:18622] 3 exiting: rc = 0 00000100:00100000:1.0:1787869008.128303:0:17073:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93d987125200:17073] 0 exiting: rc = 1 00000100:00100000:2.0:1787869008.129267:0:17075:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93dabeea9000:17075] 2 exiting: rc = 0 00000100:00100000:0.0:1787869008.129378:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129385:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129391:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129474:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129481:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129488:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129495:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129501:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129507:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129511:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129517:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129522:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129527:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129532:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129538:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129543:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129551:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129555:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129561:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129566:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129572:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129577:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129582:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129588:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129606:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129611:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129616:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129635:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129641:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129646:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129651:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129657:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129662:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129742:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129750:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129756:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129762:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129766:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129772:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129778:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129853:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129862:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129868:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129874:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129879:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129885:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129892:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129898:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129903:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129908:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129913:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129918:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129923:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129927:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129933:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129939:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129945:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129950:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129956:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129970:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129976:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129980:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129985:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.129991:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787869008.131342:0:21266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787869008.131354:0:21266:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1787869008.131360:0:21266:0:(genops.c:885:class_export_put()) final put ffff93d981c0e000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1787869008.131365:0:21266:0:(genops.c:844:class_export_destroy()) destroying export ffff93d981c0e000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1787869008.131371:0:21266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1787869008.131537:0:21266:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d9871e8000 1 00000020:00000080:0.0:1787869008.131543:0:21266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2f11f4d3bde2e4dd 00000020:00000080:0.0:1787869008.131549:0:21266:0:(genops.c:885:class_export_put()) final put ffff93daad06a000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787869008.131565:0:21266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787869008.131569:0:21266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787869008.131574:0:21266:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787869008.131577:0:21266:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff93dabd2fced8) has no exports 00000020:00000080:1.0:1787869008.131753:0:13937:0:(genops.c:844:class_export_destroy()) destroying export ffff93daad06a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787869008.170117:0:21266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787869008.170131:0:21266:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787869008.170137:0:21266:0:(genops.c:885:class_export_put()) final put ffff93d9871ef000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787869008.170142:0:21266:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9871ef000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787869008.170243:0:21266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787869008.172300:0:21266:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93d9871ee800 00000020:01000000:2.0:1787869008.172335:0:21266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787869008.172340:0:21266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787869008.172346:0:21266:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787869008.172350:0:21266:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff93dabda58000) has no exports 00000020:00000080:2.0:1787869008.172372:0:21266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787869008.172382:0:21266:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787869008.172387:0:21266:0:(genops.c:885:class_export_put()) final put ffff93daad081800/OSS_uuid 00000020:00000080:2.0:1787869008.172390:0:21266:0:(genops.c:844:class_export_destroy()) destroying export ffff93daad081800/OSS_uuid for OSS 00000020:01000000:2.0:1787869008.172402:0:21266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787869008.172556:0:17084:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787869008.172785:0:18597:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff93daacf1e000:18597] 2 exiting: rc = 0 00000100:00100000:1.0:1787869008.172902:0:20228:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff93daace7ee00:20228] 4 exiting: rc = 0 00000100:00100000:1.0:1787869008.173611:0:18596:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff93daacf1f200:18596] 1 exiting: rc = 0 00000100:00100000:1.0:1787869008.173687:0:19034:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff93d988a4b800:19034] 3 exiting: rc = 0 00000100:00100000:0.0:1787869008.173951:0:18594:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff93daa17b0a00:18594] 0 exiting: rc = 1 00000100:00100000:2.0:1787869008.174661:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174670:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174682:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174688:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174693:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174697:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174702:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174707:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174712:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174788:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174795:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174800:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174805:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174811:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174817:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174835:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174840:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174844:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174850:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174855:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174860:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174866:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174871:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174876:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174880:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174885:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174890:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174895:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174900:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174905:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174910:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174915:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174921:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174926:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174932:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174939:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174945:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174950:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174957:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174963:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174968:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174974:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174979:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174984:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174990:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.174996:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175007:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175013:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175019:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175023:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175034:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175040:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175045:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175050:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175057:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175061:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175066:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175071:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175075:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175081:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175087:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175092:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175096:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.175102:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.179480:0:18598:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93daacf1ea00:18598] 0 exiting: rc = 1 00000100:00100000:3.0:1787869008.179659:0:18599:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93dabd827600:18599] 1 exiting: rc = 0 00000100:00100000:2.0:1787869008.179809:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179816:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179822:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179827:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179832:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179839:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179844:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179849:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179854:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179859:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179864:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179869:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179874:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179878:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179883:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179888:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179892:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179896:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179901:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179905:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179910:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179932:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179937:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179943:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179948:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179953:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179959:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179964:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179969:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179974:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179979:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179985:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179991:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.179997:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180003:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180008:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180013:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180018:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180023:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180027:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180031:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180037:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180041:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180046:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180050:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180055:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180060:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180064:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180069:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180073:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180078:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180082:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180086:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180091:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180096:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180101:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180112:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180118:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180123:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180128:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180132:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180137:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180142:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.180406:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.181805:0:18601:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93da93094c00:18601] 1 exiting: rc = 0 00000100:00100000:0.0:1787869008.182001:0:18602:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93da812e7000:18602] 2 exiting: rc = 0 00000100:00100000:1.0:1787869008.182562:0:18600:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93da9380c600:18600] 0 exiting: rc = 1 00000100:00100000:2.0:1787869008.182693:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182702:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182708:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182724:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182731:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182736:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182742:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182747:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182752:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182775:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182782:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182788:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182793:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182799:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182805:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182810:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182815:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182821:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182826:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182832:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182837:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182842:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182848:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182854:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182859:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182865:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182871:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182892:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182897:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182902:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182908:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182914:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182920:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182938:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182944:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182950:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182955:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182961:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182966:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182971:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182976:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182981:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182987:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182992:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.182997:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183003:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183009:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183014:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183020:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183026:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183031:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183036:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183040:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183045:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183050:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183056:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183061:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183076:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183084:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183089:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183095:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183100:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183113:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.183119:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787869008.192374:0:18603:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93d987c1ca00:18603] 0 exiting: rc = 1 00000100:00100000:1.0:1787869008.192678:0:18604:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93d987c1de00:18604] 1 exiting: rc = 0 00000100:00100000:2.0:1787869008.192795:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192802:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192807:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192813:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192818:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192823:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192828:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192834:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192839:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192844:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192850:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192855:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192861:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192867:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192873:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192878:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192882:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192888:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192894:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192899:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192904:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192909:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192914:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192920:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192926:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192931:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192937:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192943:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192948:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192952:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192958:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192962:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192967:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192984:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192989:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192994:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.192999:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193003:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193007:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193012:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193017:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193021:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193027:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193033:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193037:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193042:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193047:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193052:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193057:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193062:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193068:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193074:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193079:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193084:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193089:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193094:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193100:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193105:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193110:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193115:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193121:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193127:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193132:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193137:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.193885:0:18606:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93dab5b41000:18606] 1 exiting: rc = 0 00000100:00100000:0.0:1787869008.197106:0:18605:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93d987c1d600:18605] 0 exiting: rc = 1 00000100:00100000:2.0:1787869008.202115:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202128:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202134:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202191:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202197:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202223:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202231:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202238:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202244:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202249:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202256:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202262:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202267:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202274:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202280:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202286:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202291:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202314:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202321:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202327:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202333:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202339:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202345:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202351:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202357:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202363:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202369:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202375:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202381:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202401:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202408:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202413:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202419:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202424:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202430:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202436:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202442:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202447:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202461:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202466:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202472:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202491:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202497:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202503:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202510:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202517:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202523:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202529:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202535:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202541:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202547:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202553:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202559:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202580:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202587:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202594:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202600:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202606:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202612:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202628:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202635:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202641:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202647:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787869008.202660:0:21266:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787869008.222452:0:21266:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787869031.028264:0:22033:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787869042.380765:0:22633:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787869042.380773:0:22633:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787869042.380774:0:22633:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787869042.380889:0:22633:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93dab523f000 00000020:01000004:2.0:1787869042.380918:0:22633:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787869042.380926:0:22633:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787869042.380941:0:22633:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93dabd2fced8) 00000020:00000080:2.0:1787869042.380968:0:22633:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787869042.454640:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787869042.455719:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787869042.456939:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787869042.457622:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787869042.457850:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787869042.458085:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787869042.458441:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787869042.458690:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787869042.458879:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787869042.459125:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787869042.459531:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787869042.459753:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787869042.459926:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787869042.460144:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787869042.462385:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1787869042.463305:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787869042.463510:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787869042.463672:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787869042.463864:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787869042.464120:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787869042.464715:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787869042.464929:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787869042.468150:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787869042.472633:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787869042.473095:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787869042.473503:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787869042.473744:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787869042.473997:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787869042.474279:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787869042.474511:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787869042.474758:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787869042.475026:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787869042.475310:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787869042.475518:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787869042.475728:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787869042.476443:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787869042.476920:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787869042.479279:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787869042.479999:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787869042.480444:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787869042.480711:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787869042.480930:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787869042.481418:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787869042.481673:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787869042.481910:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1787869042.482279:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787869042.482487:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787869042.483541:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787869042.484011:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787869042.484283:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787869042.484706:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787869042.484944:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1787869042.485202:0:22633:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1787869042.486664:0:22633:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787869042.486895:0:22633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787869042.486905:0:22633:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787869042.486919:0:22633:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2ea1d 00000020:01000004:3.0:1787869042.486927:0:22633:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787869042.486932:0:22633:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787869042.486938:0:22633:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93dab523f000 from MGS 00000020:01000004:3.0:1787869042.486942:0:22633:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787869042.486952:0:22633:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93d987f84ed8) 00000020:00000080:3.0:1787869042.486976:0:22633:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787869042.487041:0:22633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93dab523f000 from MGS, refs=2 00080000:01000000:3.0:1787869042.487046:0:22633:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787869042.488297:0:22633:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2ea2b 00000100:00100000:3.0:1787869042.488445:0:22633:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787869042.488590:0:22633:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787869042.488596:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787869042.492842:0:22633:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787869042.492859:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787869042.502466:0:22633:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787869042.502670:0:22633:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787869042.502683:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787869042.508747:0:22633:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787869042.508763:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787869042.509587:0:22633:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787869042.509613:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787869042.510324:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869042.510328:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869042.510330:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869042.510575:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869042.510581:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869042.510583:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869042.510991:0:22633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787869042.515704:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787869042.522109:0:22633:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787869042.529456:0:22645:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787869042.538759:0:22633:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787869042.538846:0:22633:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787869042.540635:0:22633:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787869042.540937:0:22633:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787869042.541144:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787869042.541151:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787869042.541867:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787869042.541874:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787869042.542889:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787869042.542898:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787869042.544075:0:22633:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787869042.544100:0:22633:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.127@tcp' 00000020:01000004:2.0:1787869042.544102:0:22633:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787869042.544133:0:22633:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.127@tcp (typ=mgc) 00000020:00000080:2.0:1787869042.544147:0:22633:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.127@tcp (ffff93dabd2f9a48) 00000020:00000080:2.0:1787869042.544616:0:22633:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787869042.544704:0:22633:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dab523c000@MGC192.168.204.127@tcp: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1787869042.544865:0:22633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.127@tcp-0 is initialized 00000040:01000000:2.0:1787869042.544872:0:22633:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787869042.553011:0:22650:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787869042.555142:0:22651:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787869042.555333:0:22633:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.127@tcp (uuid 8a462b6e-823a-4baf-a873-a4eb993ef5c7) 00000020:00000080:3.0:1787869042.555358:0:22633:0:(genops.c:1385:class_connect()) connect: client 8a462b6e-823a-4baf-a873-a4eb993ef5c7, cookie 0x2f11f4d3bde2ea39 00000100:00080000:3.0:1787869042.555371:0:22633:0:(import.c:510:import_select_connection()) MGC192.168.204.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787869042.555377:0:22633:0:(import.c:624:import_select_connection()) MGC192.168.204.127@tcp: import ffff93dab523c000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787869042.555415:0:22633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9888c1680 x1874715939679744/t0(0) o250->MGC192.168.204.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787869042.555450:0:22633:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8a462b6e-823a-4baf-a873-a4eb993ef5c7->MGS 00000020:01000004:3.0:1787869042.555476:0:22633:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787869042.555482:0:22633:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787869042.555498:0:22633:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93d987f83490) 00000020:00000080:3.0:1787869042.555512:0:22633:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787869042.556236:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3635:1874715939679744:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787869042.556315:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869042.556410:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939679744 00000100:00100000:0.0:1787869042.556419:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939679744 00000100:00100000:0.0:1787869042.556456:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787869042.556464:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3635:x1874715939679744:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787869042.556496:0:22647:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 8a462b6e-823a-4baf-a873-a4eb993ef5c7@0@lo t0 exp 0000000000000000 cur 666 last 0 00000020:00000080:0.0:1787869042.556525:0:22647:0:(genops.c:1385:class_connect()) connect: client 8a462b6e-823a-4baf-a873-a4eb993ef5c7, cookie 0x2f11f4d3bde2ea47 00000100:00080000:0.0:1787869042.556676:0:22647:0:(import.c:65:import_set_state_nolock()) ffff93da86343800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787869042.556754:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+5:3635:x1874715939679744:12345-0@lo:250:mount.lustre.0 Request processed in 289us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869042.556763:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787869042.556828:0:3635:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787869042.556837:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.127@tcp: connect to target with instance 0 00000100:00080000:0.0:1787869042.556845:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787869042.556849:0:3635:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787869042.556853:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab523c000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787869042.556855:0:3635:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787869042.556859:0:3635:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787869042.556863:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3635:1874715939679744:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787869042.587459:0:22633:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787869042.587716:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787869042.587723:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787869042.601768:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787869042.601784:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787869042.604807:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787869042.604825:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787869042.605777:0:22633:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787869042.605999:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787869042.606005:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787869042.606690:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787869042.606704:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787869042.643658:0:22633:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787869042.643949:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787869042.643967:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787869042.648737:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787869042.648751:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787869042.652520:0:22633:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787869042.652713:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787869042.652720:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787869042.655653:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787869042.655673:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787869042.662836:0:22633:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787869042.663043:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787869042.663273:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787869042.669731:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787869042.669748:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787869042.670539:0:22633:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787869042.670733:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787869042.670740:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787869042.674206:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787869042.674224:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787869042.694695:0:22633:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787869042.694919:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787869042.694926:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787869042.697667:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787869042.697682:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787869042.699552:0:22633:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787869042.699566:0:22633:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787869042.701518:0:22633:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787869042.701550:0:22633:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787869042.701557:0:22633:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787869042.701677:0:22633:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787869042.701714:0:22633:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787869042.701718:0:22633:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787869042.701720:0:22633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787869042.701721:0:22633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787869042.701722:0:22633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787869042.701724:0:22633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787869042.701725:0:22633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787869042.701727:0:22633:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787869042.701728:0:22633:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787869042.701730:0:22633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787869042.701732:0:22633:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787869042.701734:0:22633:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787869042.701736:0:22633:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787869042.701737:0:22633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787869042.701738:0:22633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787869042.701739:0:22633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787869042.701740:0:22633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787869042.701741:0:22633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787869042.701743:0:22633:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787869042.701744:0:22633:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787869042.701745:0:22633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787869042.701752:0:22633:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787869042.701781:0:22633:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787869042.701803:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f58780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939679872:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787869042.701881:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869042.701977:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa0f3dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787869042.702038:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939679872 00000100:00100000:1.0:1787869042.702117:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939679872 00000100:00100000:1.0:1787869042.702436:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787869042.702448:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+5:22633:x1874715939679872:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787869042.702510:0:22649:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787869042.702514:0:22649:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787869042.702517:0:22649:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787869042.702856:0:22670:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787869042.705477:0:22649:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1787869042.707142:0:22671:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787869042.707149:0:22671:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1787869042.707187:0:22671:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787869042.707191:0:22671:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787869042.707492:0:22671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1787869042.707678:0:22649:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787869042.707691:0:22649:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787869042.709532:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+5:22633:x1874715939679872:12345-0@lo:253:mount.lustre.0 Request processed in 7077us (7641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869042.709555:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787869042.709652:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f58780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939679872:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787869042.709672:0:22633:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787869042.709675:0:22633:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787869042.709677:0:22633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787869042.709678:0:22633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787869042.709680:0:22633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787869042.709779:0:22633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787869042.709781:0:22633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787869042.709783:0:22633:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787869042.709785:0:22633:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787869042.709786:0:22633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787869042.709788:0:22633:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787869042.709807:0:22633:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93dab523f000 from lustre-MDT0000 10000000:01000000:0.0:1787869042.709838:0:22633:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787869042.709842:0:22633:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787869042.709846:0:22633:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93dabd2f9a48 10000000:01000000:0.0:1787869042.709850:0:22633:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787869042.709861:0:22633:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93dabd2f9a48 from 1 10000000:01000000:0.0:1787869042.709864:0:22633:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787869042.709912:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.709938:0:22633:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.709949:0:22633:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869042.709988:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f55a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939680000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787869042.710030:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869042.710195:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e200c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787869042.710373:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939680000 00000100:00100000:2.0:1787869042.710381:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939680000 00000100:00100000:2.0:1787869042.710452:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787869042.710463:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+5:22633:x1874715939680000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787869042.710477:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869042.710494:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab52a4600/0x2f11f4d3bde2ea55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ea4e expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.710519:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab52a4600/0x2f11f4d3bde2ea55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ea4e expref: 6 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.710529:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab52a4600/0x2f11f4d3bde2ea55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ea4e expref: 6 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.710538:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a4600, rc 0) 00000100:00100000:2.0:1787869042.710583:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+6:22633:x1874715939680000:12345-0@lo:101:mount.lustre.0 Request processed in 123us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869042.710590:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787869042.710682:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f55a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939680000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787869042.710698:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea55 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.710706:0:22633:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ea55 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869042.710782:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939680128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787869042.710812:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869042.710889:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99e9f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787869042.710924:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939680128 00000100:00100000:0.0:1787869042.710928:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939680128 00000100:00100000:0.0:1787869042.710963:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787869042.710971:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+6:22633:x1874715939680128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787869042.711282:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+6:22633:x1874715939680128:12345-0@lo:501:mount.lustre.0 Request processed in 186us (341us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787869042.711289:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787869042.711358:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939680128:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787869042.711390:0:22633:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787869042.711445:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea55 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.711468:0:22633:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea55 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869042.711477:0:22633:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93dab523f000 10000000:01000000:3.0:1787869042.711482:0:22633:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787869042.711486:0:22633:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93dab523f000 10000000:01000000:3.0:1787869042.711488:0:22633:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787869042.711491:0:22633:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93dab523f000 from 1 10000000:01000000:3.0:1787869042.711493:0:22633:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787869042.711516:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871e00/0x2f11f4d3bde2ea5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.711523:0:22633:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd871e00/0x2f11f4d3bde2ea5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.711530:0:22633:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd871e00/0x2f11f4d3bde2ea5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869042.711543:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939680256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787869042.711585:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869042.711611:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99e9f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787869042.712233:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939680256 00000100:00100000:0.0:1787869042.712240:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939680256 00000100:00100000:0.0:1787869042.712267:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787869042.712274:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+6:22633:x1874715939680256:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787869042.712298:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869042.712313:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93daace1d400/0x2f11f4d3bde2ea63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ea5c expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.712332:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93daace1d400/0x2f11f4d3bde2ea63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ea5c expref: 7 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.712355:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93daace1d400/0x2f11f4d3bde2ea63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ea5c expref: 7 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.712364:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1d400, rc 0) 00000100:00100000:0.0:1787869042.712406:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+7:22633:x1874715939680256:12345-0@lo:101:mount.lustre.0 Request processed in 132us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869042.712413:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787869042.712707:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939680256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787869042.712724:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd871e00/0x2f11f4d3bde2ea5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea63 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.712734:0:22633:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd871e00/0x2f11f4d3bde2ea5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ea63 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869042.712763:0:22633:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787869042.712931:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871e00/0x2f11f4d3bde2ea5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea63 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.712940:0:22633:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd871e00/0x2f11f4d3bde2ea5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea63 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869042.712948:0:22633:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787869042.712963:0:22633:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787869042.712969:0:22633:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93dab523f000 10000000:01000000:3.0:1787869042.712972:0:22633:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787869042.712975:0:22633:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787869042.712977:0:22633:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787869042.712998:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871600/0x2f11f4d3bde2ea6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.713005:0:22633:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd871600/0x2f11f4d3bde2ea6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.713014:0:22633:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd871600/0x2f11f4d3bde2ea6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869042.713031:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939680384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787869042.713146:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869042.713197:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99e9f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787869042.713302:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939680384 00000100:00100000:0.0:1787869042.713307:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939680384 00000100:00100000:0.0:1787869042.713373:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787869042.713382:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+7:22633:x1874715939680384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787869042.713391:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869042.713400:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93daace1ce00/0x2f11f4d3bde2ea71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ea6a expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.713417:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93daace1ce00/0x2f11f4d3bde2ea71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ea6a expref: 8 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.713425:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93daace1ce00/0x2f11f4d3bde2ea71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ea6a expref: 8 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.713431:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1ce00, rc 0) 00000100:00100000:0.0:1787869042.713473:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+8:22633:x1874715939680384:12345-0@lo:101:mount.lustre.0 Request processed in 92us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869042.713479:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787869042.713556:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939680384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787869042.713568:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd871600/0x2f11f4d3bde2ea6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea71 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.713582:0:22633:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd871600/0x2f11f4d3bde2ea6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ea71 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869042.713630:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939680512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787869042.713653:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869042.714012:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99e9f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787869042.714085:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939680512 00000100:00100000:2.0:1787869042.714090:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939680512 00000100:00100000:2.0:1787869042.714118:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787869042.714125:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+8:22633:x1874715939680512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787869042.714293:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+9:22633:x1874715939680512:12345-0@lo:501:mount.lustre.0 Request processed in 169us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869042.714301:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787869042.714444:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939680512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787869042.714474:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939680640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787869042.714515:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869042.714539:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99e9f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787869042.714590:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939680640 00000100:00100000:2.0:1787869042.714594:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939680640 00000100:00100000:2.0:1787869042.714612:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787869042.714619:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+9:22633:x1874715939680640:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787869042.715288:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+9:22633:x1874715939680640:12345-0@lo:503:mount.lustre.0 Request processed in 668us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869042.715296:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787869042.715485:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939680640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787869042.720661:0:22672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22672:1874715939680768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787869042.723798:0:22672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869042.723863:0:22672:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0e5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787869042.723949:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939680768 00000100:00100000:3.0:1787869042.723971:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939680768 00000100:00100000:3.0:1787869042.724030:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787869042.724042:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+9:22672:x1874715939680768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787869042.725078:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+9:22672:x1874715939680768:12345-0@lo:502:llog_process_th.0 Request processed in 1035us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869042.725089:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787869042.725339:0:22672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22672:1874715939680768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787869042.725380:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787869042.725394:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787869042.725397:0:22672:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787869042.725402:0:22672:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787869042.725405:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787869042.725421:0:22672:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93dabd2f8000) 00000020:00000080:2.0:1787869042.725440:0:22672:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787869042.725445:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787869042.725536:0:22672:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787869042.725544:0:22672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2ea7f 00000020:00000080:2.0:1787869042.725777:0:22672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787869042.725782:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787869042.725786:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787869042.725795:0:22672:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787869042.725798:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787869042.725801:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787869042.725803:0:22672:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787869042.725806:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787869042.725813:0:22672:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93dabd2fb490) 00000020:00000080:2.0:1787869042.725824:0:22672:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787869042.725828:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787869042.725830:0:22672:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787869042.725833:0:22672:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787869042.725840:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787869042.725893:0:22672:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93dab523f000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787869042.725916:0:22672:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93da86ef8000) 00000020:00000080:2.0:1787869042.725925:0:22672:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787869042.725987:0:22672:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787869042.725993:0:22672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2ea94 00000020:00000080:2.0:1787869042.726091:0:22672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787869042.726097:0:22672:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787869042.726102:0:22672:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2f11f4d3bde2ea9b 00080000:01000000:2.0:1787869042.726106:0:22672:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787869042.726110:0:22672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2eaa2 00010000:00010000:3.0:1787869042.795151:0:22672:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787869042.796191:0:22672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:3.0:1787869042.796766:0:22672:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787869042.797891:0:22672:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93d987f81a48) 00000020:00000080:3.0:1787869042.797915:0:22672:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787869042.798022:0:22672:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787869042.798035:0:22672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2eab0 00000020:00000080:2.0:1787869042.799314:0:22672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787869042.807136:0:22672:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2f11f4d3bde2eab7 00000020:00000080:1.0:1787869042.807558:0:22672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787869042.807571:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787869042.807578:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787869042.807581:0:22672:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787869042.807585:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787869042.807587:0:22672:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1787869042.807589:0:22672:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787869042.807591:0:22672:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787869042.807592:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787869042.807595:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787869042.807596:0:22672:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787869042.807599:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787869042.807605:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787869042.807606:0:22672:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787869042.807611:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787869042.807656:0:22672:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787869042.807674:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787869042.807678:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787869042.807679:0:22672:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787869042.807682:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787869042.807685:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787869042.807686:0:22672:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787869042.807689:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787869042.807695:0:22672:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:1.0:1787869042.807726:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787869042.807742:0:22672:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff93dabc0b8000) 00000020:00000080:1.0:1787869042.807756:0:22672:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787869042.807766:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787869042.807817:0:22672:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787869042.807822:0:22672:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787869042.807828:0:22672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2eac5 00010000:00080000:1.0:1787869042.807863:0:22672:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93da86347800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1787869042.810557:0:22672:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1787869042.813657:0:22672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787869042.813686:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787869042.813731:0:22672:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787869042.813757:0:22672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2eacc 00000100:00080000:1.0:1787869042.813770:0:22672:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787869042.813776:0:22672:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93da86347800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787869042.813818:0:22672:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dabed0b480 x1874715939680896/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787869042.813851:0:22672:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1787869042.813992:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787869042.813997:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787869042.813999:0:22672:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787869042.814001:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787869042.814004:0:22672:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1787869042.814006:0:22672:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787869042.814008:0:22672:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787869042.814009:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787869042.814011:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787869042.814013:0:22672:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787869042.814016:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787869042.814021:0:22672:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787869042.814025:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787869042.814026:0:22672:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787869042.814029:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787869042.814032:0:22672:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:1.0:1787869042.814069:0:22672:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787869042.814072:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787869042.814084:0:22672:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93dabc0bb490) 00000020:00000080:1.0:1787869042.814094:0:22672:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787869042.814098:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787869042.814150:0:22672:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787869042.814177:0:22672:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787869042.814183:0:22672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2eada 00010000:00080000:1.0:1787869042.814216:0:22672:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d981c0d800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1787869042.814407:0:22672:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1787869042.814439:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939680896:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787869042.814515:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869042.814636:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939680896 00000100:00100000:2.0:1787869042.814644:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939680896 00000100:00100000:2.0:1787869042.814682:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787869042.814690:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1874715939680896:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1787869042.814706:0:22659:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1787869042.816447:0:22672:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787869042.816881:0:22672:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787869042.822646:0:22672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787869042.824578:0:22672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1787869042.834430:0:22672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1787869042.836617:0:22678:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787869042.836625:0:22678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787869042.837899:0:22672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787869042.837915:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787869042.837965:0:22672:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787869042.837989:0:22672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2eae1 00000100:00080000:0.0:1787869042.838001:0:22672:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787869042.838008:0:22672:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d981c0d800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787869042.838043:0:22672:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab6f57c00 x1874715939681024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787869042.838113:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939681024:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787869042.838206:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939681024 offset 0 length 520: 4 00000100:00080000:0.0:1787869042.838420:0:22672:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787869042.838484:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787869042.838489:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869042.838490:0:22672:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787869042.838493:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787869042.838496:0:22672:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1787869042.838498:0:22672:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787869042.838499:0:22672:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787869042.838501:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787869042.838503:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869042.838504:0:22672:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787869042.838507:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787869042.838511:0:22672:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787869042.838515:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869042.838516:0:22672:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787869042.838519:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787869042.838523:0:22672:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:0.0:1787869042.838548:0:22672:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787869042.838551:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787869042.838563:0:22672:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93dabda5ced8) 00000020:00000080:0.0:1787869042.838575:0:22672:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1787869042.838593:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787869042.838650:0:22672:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787869042.838656:0:22672:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787869042.838661:0:22672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2f11f4d3bde2eaef 00010000:00080000:0.0:1787869042.838688:0:22672:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d98895e800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1787869042.838894:0:22672:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787869042.838978:0:22672:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787869042.838994:0:22672:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787869042.847366:0:22672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787869042.849825:0:22672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1787869042.850403:0:22672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:3.0:1787869042.853907:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1874715939680896:12345-0@lo:38:llog_process_th.0 Request processed in 39210us (39384us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787869042.853927:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1787869042.854539:0:22680:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787869042.854544:0:22680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000100:00080000:1.0:1787869042.854852:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da86347800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787869042.854859:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787869042.854864:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939680896:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1787869042.856928:0:22672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787869042.856946:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787869042.856999:0:22672:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787869042.857021:0:22672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2eaf6 00000100:00080000:0.0:1787869042.857032:0:22672:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787869042.857038:0:22672:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d98895e800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787869042.857091:0:22672:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab6f570c0 x1874715939681152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787869042.857367:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939681152:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787869042.857425:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939681152 offset 0 length 520: 4 00000100:00080000:0.0:1787869042.857512:0:22672:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787869042.857577:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787869042.857582:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869042.857584:0:22672:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787869042.857588:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787869042.857592:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869042.857593:0:22672:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787869042.857596:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787869042.857598:0:22672:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787869042.857600:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787869042.857603:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869042.857604:0:22672:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787869042.857613:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787869042.857616:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869042.857618:0:22672:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787869042.857621:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787869042.857650:0:22672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f55680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22672:1874715939681280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787869042.857699:0:22672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869042.857719:0:22672:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e20840 going to sleep for 11 seconds 00000100:00100000:1.0:1787869042.857860:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939681280 00000100:00100000:1.0:1787869042.857868:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939681280 00000100:00100000:1.0:1787869042.857960:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787869042.857970:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+9:22672:x1874715939681280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787869042.858114:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+9:22672:x1874715939681280:12345-0@lo:502:llog_process_th.0 Request processed in 145us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869042.858129:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787869042.858447:0:22672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f55680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22672:1874715939681280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787869042.858475:0:22672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787869042.858485:0:22672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787869042.858487:0:22672:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787869042.858492:0:22672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787869042.858812:0:22633:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787869042.858836:0:22633:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787869042.859118:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871600/0x2f11f4d3bde2ea6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea71 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.859133:0:22633:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd871600/0x2f11f4d3bde2ea6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea71 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869042.859142:0:22633:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93dab523f000 from 1 10000000:01000000:3.0:1787869042.859146:0:22633:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787869042.859520:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.859529:0:22633:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.859538:0:22633:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869042.859557:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939681408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787869042.859604:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869042.859643:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747900 going to sleep for 11 seconds 00000100:00100000:2.0:1787869042.859697:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939681408 00000100:00100000:2.0:1787869042.859703:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939681408 00000100:00100000:2.0:1787869042.859781:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787869042.859791:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+9:22633:x1874715939681408:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787869042.859803:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869042.859817:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab52a5c00/0x2f11f4d3bde2eb04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2eafd expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.859841:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab52a5c00/0x2f11f4d3bde2eb04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eafd expref: 10 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.859852:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab52a5c00/0x2f11f4d3bde2eb04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eafd expref: 10 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.859861:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a5c00, rc 0) 00000100:00100000:2.0:1787869042.859908:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+10:22633:x1874715939681408:12345-0@lo:101:mount.lustre.0 Request processed in 119us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869042.859914:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787869042.859989:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939681408:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787869042.860006:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb04 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.860028:0:22633:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2eb04 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869042.860615:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939681536:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787869042.860655:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869042.861240:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747900 going to sleep for 11 seconds 00000100:00100000:0.0:1787869042.861403:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939681536 00000100:00100000:0.0:1787869042.861410:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939681536 00000100:00100000:0.0:1787869042.861446:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787869042.861453:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+10:22633:x1874715939681536:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787869042.861472:0:22647:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787869042.861479:0:22647:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787869042.861569:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+10:22633:x1874715939681536:12345-0@lo:256:mount.lustre.0 Request processed in 116us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869042.861577:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787869042.861663:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939681536:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787869042.862434:0:22633:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787869042.862456:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb04 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.862467:0:22633:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb04 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869042.862475:0:22633:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dab523f000 from 1 10000000:01000000:3.0:1787869042.862478:0:22633:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787869042.862511:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.862518:0:22633:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.862527:0:22633:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869042.862543:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939681664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787869042.862586:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869042.862623:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747900 going to sleep for 11 seconds 00000100:00100000:0.0:1787869042.862731:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939681664 00000100:00100000:0.0:1787869042.862738:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939681664 00000100:00100000:0.0:1787869042.862766:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787869042.862772:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+10:22633:x1874715939681664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787869042.862782:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869042.862796:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93daace1c600/0x2f11f4d3bde2eb12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2eb0b expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.862817:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93daace1c600/0x2f11f4d3bde2eb12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eb0b expref: 11 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.862826:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93daace1c600/0x2f11f4d3bde2eb12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eb0b expref: 11 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.862846:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1c600, rc 0) 00000100:00100000:0.0:1787869042.862891:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+11:22633:x1874715939681664:12345-0@lo:101:mount.lustre.0 Request processed in 118us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869042.862898:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787869042.863407:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939681664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787869042.863422:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb12 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.863430:0:22633:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2eb12 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869042.863492:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939681792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787869042.863523:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869042.863553:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747900 going to sleep for 11 seconds 00000100:00100000:0.0:1787869042.863601:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939681792 00000100:00100000:0.0:1787869042.863606:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939681792 00000100:00100000:0.0:1787869042.863634:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787869042.863641:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+11:22633:x1874715939681792:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787869042.863795:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+11:22633:x1874715939681792:12345-0@lo:501:mount.lustre.0 Request processed in 153us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869042.863801:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787869042.864047:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939681792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787869042.864076:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939681920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787869042.864119:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869042.864139:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747900 going to sleep for 11 seconds 00000100:00100000:0.0:1787869042.864346:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939681920 00000100:00100000:0.0:1787869042.864351:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939681920 00000100:00100000:0.0:1787869042.864378:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787869042.864385:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+11:22633:x1874715939681920:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787869042.864477:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+11:22633:x1874715939681920:12345-0@lo:503:mount.lustre.0 Request processed in 93us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869042.864484:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787869042.864630:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939681920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787869042.865088:0:22682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22682:1874715939682048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787869042.865128:0:22682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869042.865307:0:22682:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787869042.865353:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939682048 00000100:00100000:0.0:1787869042.865357:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939682048 00000100:00100000:0.0:1787869042.865423:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787869042.865431:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+11:22682:x1874715939682048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787869042.865961:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+11:22682:x1874715939682048:12345-0@lo:502:llog_process_th.0 Request processed in 520us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869042.865969:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787869042.866058:0:22682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22682:1874715939682048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787869042.866088:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869042.866097:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869042.866099:0:22682:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787869042.866106:0:22682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93dab523f000 00000020:00000080:3.0:1787869042.866109:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787869042.866118:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869042.866125:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869042.866127:0:22682:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787869042.866130:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869042.866132:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869042.866133:0:22682:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787869042.866137:0:22682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93dab523f000 00000020:00000080:3.0:1787869042.866139:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787869042.866469:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869042.866475:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869042.866476:0:22682:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787869042.866479:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869042.866482:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869042.866483:0:22682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787869042.866487:0:22682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93dab523f000 00000020:00000080:3.0:1787869042.866489:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787869042.866508:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869042.866511:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869042.866512:0:22682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787869042.866514:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869042.866516:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869042.866517:0:22682:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787869042.866520:0:22682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93dab523f000 00000020:00000080:3.0:1787869042.866522:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787869042.866559:0:22682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22682:1874715939682176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787869042.866602:0:22682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869042.866847:0:22682:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa1747f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787869042.866883:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939682176 00000100:00100000:2.0:1787869042.866898:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939682176 00000100:00100000:2.0:1787869042.866929:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787869042.866937:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+11:22682:x1874715939682176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787869042.867065:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+11:22682:x1874715939682176:12345-0@lo:502:llog_process_th.0 Request processed in 129us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869042.867072:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787869042.867150:0:22682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22682:1874715939682176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787869042.867209:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869042.867214:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869042.867216:0:22682:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787869042.867220:0:22682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787869042.867670:0:22633:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787869042.867768:0:22633:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787869042.867786:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb12 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.867796:0:22633:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb12 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787869042.867844:0:22633:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787869042.867847:0:22633:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93dab523f000 10000000:01000000:2.0:1787869042.867850:0:22633:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93dab523f000 10000000:01000000:2.0:1787869042.867855:0:22633:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787869042.867860:0:22633:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93dab523f000 from 1 10000000:01000000:2.0:1787869042.867863:0:22633:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787869042.867904:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab52a5400/0x2f11f4d3bde2eb19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.867912:0:22633:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab52a5400/0x2f11f4d3bde2eb19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.867922:0:22633:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab52a5400/0x2f11f4d3bde2eb19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869042.867939:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939682304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787869042.867986:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869042.868019:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc053f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787869042.868252:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939682304 00000100:00100000:3.0:1787869042.868262:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939682304 00000100:00100000:3.0:1787869042.868287:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787869042.868294:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+11:22633:x1874715939682304:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787869042.868303:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869042.868316:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2eb20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2eb19 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.868336:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2eb20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eb19 expref: 12 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.868346:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871000/0x2f11f4d3bde2eb20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eb19 expref: 12 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.868355:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871000, rc 0) 00000100:00100000:3.0:1787869042.868390:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22633:x1874715939682304:12345-0@lo:101:mount.lustre.0 Request processed in 97us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869042.868397:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787869042.868478:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939682304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787869042.868491:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab52a5400/0x2f11f4d3bde2eb19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb20 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.868501:0:22633:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab52a5400/0x2f11f4d3bde2eb19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2eb20 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869042.868561:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939682432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787869042.868588:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869042.868642:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc053f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787869042.868670:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939682432 00000100:00100000:3.0:1787869042.868740:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939682432 00000100:00100000:3.0:1787869042.868800:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787869042.868807:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22633:x1874715939682432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787869042.868930:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22633:x1874715939682432:12345-0@lo:501:mount.lustre.0 Request processed in 123us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869042.868936:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787869042.869073:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939682432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787869042.869099:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939682560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787869042.869134:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869042.869148:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc053f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787869042.869176:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939682560 00000100:00100000:2.0:1787869042.869180:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939682560 00000100:00100000:2.0:1787869042.869200:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787869042.869206:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22633:x1874715939682560:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787869042.869283:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22633:x1874715939682560:12345-0@lo:503:mount.lustre.0 Request processed in 76us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869042.869289:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787869042.869326:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939682560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787869042.870328:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22683:1874715939682688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787869042.870384:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869042.870410:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939682688 00000100:00100000:2.0:1787869042.870415:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939682688 00000100:00100000:2.0:1787869042.870443:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787869042.870450:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22683:x1874715939682688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787869042.870542:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22683:x1874715939682688:12345-0@lo:502:llog_process_th.0 Request processed in 92us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869042.870564:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787869042.870602:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0533c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787869042.870616:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22683:1874715939682688:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787869042.872200:0:22683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787869042.872220:0:22683:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93d987f80000) 00000020:00000080:3.0:1787869042.872243:0:22683:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1787869042.872331:0:22683:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93dab523f000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787869042.872335:0:22683:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93dab523f000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787869042.872345:0:22683:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93dab523f000 4 00010000:00080000:3.0:1787869042.872376:0:22683:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93daa051b800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1787869042.874017:0:22683:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1787869042.874231:0:22683:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787869042.874268:0:22683:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787869042.874283:0:22683:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2f11f4d3bde2eb2e 00000100:00080000:3.0:1787869042.874294:0:22683:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787869042.874300:0:22683:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93daa051b800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787869042.874335:0:22683:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9888c3840 x1874715939682816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787869042.874368:0:22683:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787869042.874579:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939682816:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787869042.874652:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869042.875311:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939682816 00000100:00100000:0.0:1787869042.875319:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939682816 00000100:00100000:0.0:1787869042.875358:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787869042.875366:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874715939682816:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787869042.875430:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874715939682816:12345-0@lo:38:llog_process_th.0 Request processed in 63us (777us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787869042.875437:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787869042.877789:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787869042.877803:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93daa051b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787869042.877810:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787869042.877815:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939682816:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787869042.882601:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22683:1874715939682944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787869042.882687:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869042.882728:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787869042.882806:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939682944 00000100:00100000:0.0:1787869042.882814:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939682944 00000100:00100000:0.0:1787869042.882866:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787869042.882876:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22683:x1874715939682944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787869042.883582:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22683:x1874715939682944:12345-0@lo:502:llog_process_th.0 Request processed in 706us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869042.883592:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787869042.883668:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22683:1874715939682944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787869042.883715:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22683:1874715939683072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787869042.883752:0:22683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869042.887665:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939683072 00000100:00100000:3.0:1787869042.887741:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939683072 00000100:00100000:3.0:1787869042.887799:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787869042.887810:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22683:x1874715939683072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787869042.887976:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22683:x1874715939683072:12345-0@lo:502:llog_process_th.0 Request processed in 167us (4222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869042.887984:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787869042.890781:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0533c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787869042.890821:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22683:1874715939683072:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787869042.890864:0:22683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787869042.890939:0:22633:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787869042.890991:0:22633:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787869042.892572:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab52a5400/0x2f11f4d3bde2eb19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb20 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.892610:0:22633:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab52a5400/0x2f11f4d3bde2eb19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb20 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787869042.892669:0:22633:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787869042.892671:0:22633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787869042.892673:0:22633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787869042.892674:0:22633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787869042.892675:0:22633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787869042.892677:0:22633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787869042.892678:0:22633:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787869042.892680:0:22633:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787869042.892682:0:22633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787869042.892683:0:22633:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787869042.892687:0:22633:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787869042.892689:0:22633:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787869042.892691:0:22633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787869042.892692:0:22633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787869042.892693:0:22633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787869042.892694:0:22633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787869042.892695:0:22633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787869042.892696:0:22633:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787869042.892697:0:22633:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787869042.892698:0:22633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787869042.892699:0:22633:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787869042.892723:0:22633:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787869042.892742:0:22633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939683200:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787869042.892809:0:22633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869042.892846:0:22633:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0539c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787869042.893691:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939683200 00000100:00100000:0.0:1787869042.893701:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939683200 00000100:00100000:0.0:1787869042.893755:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787869042.893765:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22633:x1874715939683200:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787869042.893796:0:22647:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787869042.893810:0:22647:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787869042.897692:0:22647:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787869042.897718:0:22647:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787869042.898184:0:22670:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787869042.898190:0:22670:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787869042.898215:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.898236:0:22670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab52a5c00/0x2f11f4d3bde2eb04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eafd expref: 12 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.898251:0:22670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.898292:0:22670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab52a5c00/0x2f11f4d3bde2eb04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2eafd expref: 12 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869042.898308:0:22670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab52a5c00/0x2f11f4d3bde2eb04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2eafd expref: 12 pid: 22648 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869042.898324:0:22670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22670:1874715939683328:0@lo:104: 00000100:00100000:0.0:1787869042.898394:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22633:x1874715939683200:12345-0@lo:253:mount.lustre.0 Request processed in 4628us (5583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869042.898405:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787869042.898624:0:22670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869042.898669:0:22670:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc053cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787869042.898713:0:22633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22633:1874715939683200:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787869042.898726:0:22633:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787869042.898730:0:22633:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787869042.898732:0:22633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787869042.898734:0:22633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787869042.898735:0:22633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787869042.898736:0:22633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787869042.898738:0:22633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787869042.898739:0:22633:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787869042.898741:0:22633:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787869042.898743:0:22633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787869042.898744:0:22633:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787869042.898761:0:22633:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787869042.899280:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939683328 00000100:00100000:0.0:1787869042.899290:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939683328 00000100:00100000:0.0:1787869042.899332:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787869042.899341:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f58f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+3:22670:x1874715939683328:12345-0@lo:104: 00010000:00010000:0.0:1787869042.899362:0:22637:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2eb04 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899420:0:22637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787869042.899426:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f58f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+3:22670:x1874715939683328:12345-0@lo:104: Request processed in 87us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869042.899434:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787869042.899456:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869042.899461:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2eb04 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899469:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871400 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787869042.899473:0:22643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2eb04 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899482:0:22643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2eb04 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787869042.899491:0:22643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2eb04 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787869042.899497:0:22643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787869042.899529:0:22643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2eb04 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899537:0:22643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787869042.899564:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2eb04 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899572:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eafd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2eb04 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899591:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869042.899592:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869042.899595:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787869042.899628:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939683456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787869042.899662:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869042.899713:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939683456 00000100:00100000:0.0:1787869042.899717:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939683456 00010000:00010000:0.0:1787869042.899734:0:22639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab52a5c00/0x2f11f4d3bde2eb04 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2eafd expref: 12 pid: 22648 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869042.899760:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787869042.899767:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f56d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:3636:x1874715939683456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787869042.899777:0:22639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787869042.899782:0:22639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab52a5c00/0x2f11f4d3bde2eb04 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2eafd expref: 12 pid: 22648 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899793:0:22639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab52a5c00/0x2f11f4d3bde2eb04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2eafd expref: 12 pid: 22648 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899812:0:22639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899821:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787869042.899835:0:22639:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001645872s 00010000:00010000:0.0:1787869042.899840:0:22639:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899856:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899863:0:22639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899870:0:22639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899875:0:22639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a4e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787869042.899879:0:22639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899888:0:22639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899914:0:22639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869042.899924:0:22639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787869042.899966:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f56d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:3636:x1874715939683456:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869042.899973:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787869042.900011:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939683456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787869042.908359:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab52a5c00/0x2f11f4d3bde2eb04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2eafd expref: 11 pid: 22648 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869042.908381:0:22670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22670:1874715939683328:0@lo:104: 00010000:00010000:3.0:1787869042.908419:0:22670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.908430:0:22670:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.908453:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869042.908459:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab52a4e00/0x2f11f4d3bde2eb35 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787869042.934534:0:22633:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:1.0:1787869042.935707:0:22633:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787869042.935904:0:22694:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1787869042.935909:0:22694:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1787869042.936274:0:22695:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787869042.936790:0:22633:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1787869042.938650:0:22695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787869042.941975:0:22633:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787869042.942020:0:22633:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787869042.942686:0:22633:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787869042.942695:0:22633:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787869042.942736:0:22633:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787869042.944775:0:22633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787869042.945676:0:22633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787869042.945722:0:22633:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00080000:2.0:1787869042.946752:0:22696:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff93dab7f5b0c0 x1874715939683584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869042.946766:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00000040:00080000:1.0:1787869042.948585:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:3.0:1787869042.949768:0:22633:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00000004:00080000:1.0:1787869042.950292:0:22695:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:2.0:1787869042.954826:0:22633:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1787869042.970006:0:22633:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1787869042.973713:0:22633:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787869042.973755:0:22633:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3fe4151f988 00100000:10000000:2.0:1787869042.973763:0:22633:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787869042.974516:0:22633:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787869042.974532:0:22633:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787869042.974551:0:22633:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787869042.974575:0:22633:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787869042.975686:0:22633:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787869042.979910:0:22633:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787869043.554328:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787869043.937968:0:22651:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787869043.937982:0:22651:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93dab523f000 from 11 10000000:01000000:0.0:1787869043.937990:0:22651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787869043.938064:0:22651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869043.938082:0:22651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869043.938098:0:22651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869043.938147:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f57840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939683712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787869043.938281:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869043.938344:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daafebf900 going to sleep for 11 seconds 00000040:00080000:1.0:1787869043.939924:0:22690:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787869043.939949:0:22690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787869043.940202:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939683712 00000100:00100000:3.0:1787869043.940217:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939683712 00000100:00100000:3.0:1787869043.940301:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787869043.940316:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+11:22651:x1874715939683712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787869043.940344:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869043.940370:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd871c00/0x2f11f4d3bde2eb43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2eb3c expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869043.940404:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd871c00/0x2f11f4d3bde2eb43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eb3c expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869043.940419:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd871c00/0x2f11f4d3bde2eb43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eb3c expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869043.940430:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd871c00, rc 0) 00000100:00100000:3.0:1787869043.940532:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22651:x1874715939683712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (2251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869043.940540:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787869043.940596:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f57840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939683712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787869043.940619:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb43 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869043.940631:0:22651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2eb43 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869043.940722:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f57840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939683840:0@lo:256:ll_cfg_requeue.0 00000040:00080000:1.0:1787869043.943710:0:22690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787869043.943729:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787869043.945943:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869043.946031:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daafebf900 going to sleep for 11 seconds 00000100:00100000:1.0:1787869043.948976:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939683840 00000100:00100000:1.0:1787869043.948993:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939683840 00000100:00100000:1.0:1787869043.949070:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787869043.949082:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22651:x1874715939683840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787869043.949116:0:22647:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787869043.949137:0:22647:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787869043.949141:0:22647:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1787869043.949496:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:22651:x1874715939683840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 411us (3574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869043.949505:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787869043.950016:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f57840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939683840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787869043.950096:0:22651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787869043.950115:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb43 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869043.950128:0:22651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb43 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869044.007342:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00010000:00010000:0.0:1787869044.578132:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787869044.961375:0:22690:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787869044.961386:0:22690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787869044.961511:0:22690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1787869044.961555:0:22690:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787869044.961718:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1787869045.033477:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00010000:00010000:0.0:1787869045.602635:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869046.049783:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00010000:00010000:0.0:1787869046.627119:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787869047.074686:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00010000:00010000:1.0:1787869047.649428:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869048.097730:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00000100:00080000:2.0:1787869048.101767:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787869048.101773:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787869048.101777:0:36:0:(import.c:65:import_set_state_nolock()) ffff93da86347800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787869048.101785:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 666 00000100:00080000:2.0:1787869048.101791:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787869048.101797:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93da86347800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787869048.101818:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab7f59a40 x1874715939684096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787869048.101834:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787869048.101837:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787869048.101840:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787869048.101843:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787869048.101856:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787869048.101866:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787869048.101868:0:36:0:(import.c:65:import_set_state_nolock()) ffff93daa051b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787869048.101873:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93daa051b800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787869048.101886:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab7f5a580 x1874715939684224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787869048.101910:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787869048.101925:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939683968:0@lo:400:kworker.0 00000100:00100000:2.0:1787869048.103095:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869048.103190:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939684096:0@lo:38:kworker.0 00000100:00100000:2.0:1787869048.103227:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869048.103248:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939684224:0@lo:38:kworker.0 00000100:00100000:2.0:1787869048.103271:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869048.103310:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939683968 00000100:00100000:2.0:1787869048.103316:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939683968 00000100:00100000:2.0:1787869048.103360:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787869048.103369:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:3636:x1874715939683968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787869048.103415:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:3636:x1874715939683968:12345-0@lo:400:kworker.0 Request processed in 48us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869048.103423:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787869048.103460:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939684096 00000100:00100000:2.0:1787869048.103464:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939684096 00000100:00100000:2.0:1787869048.103481:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787869048.103485:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939684096:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787869048.103501:0:22660:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787869048.103682:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939684224 00000100:00100000:3.0:1787869048.103686:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939684224 00000100:00100000:3.0:1787869048.103710:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787869048.103715:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1874715939684224:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787869048.103731:0:22656:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:3.0:1787869048.103767:0:22656:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2f11f4d3bde2eb4a 00000004:00100000:3.0:1787869048.103781:0:22656:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787869048.103928:0:22656:0:(import.c:65:import_set_state_nolock()) ffff93da88300000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787869048.104047:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939684096:12345-0@lo:38:kworker.0 Request processed in 559us (818us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787869048.104064:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787869048.104102:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da86347800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787869048.104106:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787869048.104110:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939684096:0@lo:38:kworker.0 00000100:00100000:2.0:1787869048.104135:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939683968:0@lo:400:kworker.0 00000100:00100000:3.0:1787869048.104707:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874715939684224:12345-0@lo:38:kworker.0 Request processed in 989us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869048.104717:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787869048.106099:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93dab7f5a580 x1874715939684224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787869058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787869048.106119:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787869048.106128:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787869048.106133:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787869048.106136:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93daa051b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787869048.106143:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874715939684224:0@lo:38:kworker.0 00000001:02000400:1.0:1787869048.128282:0:22939:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787869048.674191:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787869049.125177:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00000020:00000004:0.0:1787869049.278139:0:22991:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787869049.280025:0:22991:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787869049.699036:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869050.147085:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00000020:00000004:2.0:1787869050.204846:0:23041:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787869050.205005:0:23041:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787869050.721325:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787869051.169942:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00010000:00010000:3.0:1787869051.748046:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869052.194351:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787869042/real 1787869042] req@ffff93dab6f570c0 x1874715939681152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869052 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869052.194382:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93dab6f570c0 x1874715939681152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869052 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869052.194393:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787869042/real 1787869042] req@ffff93dab6f57c00 x1874715939681024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869052 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869052.194404:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93dab6f57c00 x1874715939681024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869052 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787869052.194436:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d98895e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787869052.194458:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787869052.194461:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939681152:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787869052.194467:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d981c0d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787869052.194471:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787869052.194474:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939681024:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787869052.194655:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787869052.194660:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787869052.194663:0:36:0:(import.c:65:import_set_state_nolock()) ffff93da86347800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787869052.194668:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 672 00000100:00080000:0.0:1787869052.194672:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787869052.194679:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93da86347800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787869052.194700:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab6f56580 x1874715939684480/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787869052.194722:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787869052.194725:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787869052.194727:0:36:0:(import.c:65:import_set_state_nolock()) ffff93d981c0d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787869052.194730:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 666 00000100:00080000:0.0:1787869052.194732:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787869052.194736:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d981c0d800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787869052.194746:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab6f55e00 x1874715939684608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787869052.194754:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787869052.194762:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787869052.194764:0:36:0:(import.c:65:import_set_state_nolock()) ffff93d98895e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787869052.194779:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 666 00000100:00080000:0.0:1787869052.194782:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787869052.194785:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d98895e800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787869052.194798:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab6f54000 x1874715939684736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787869052.194983:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939684864:0@lo:400:kworker.0 00000100:00100000:2.0:1787869052.195047:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869052.195102:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787869052.195109:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939684352:0@lo:400:kworker.0 00000100:00100000:2.0:1787869052.195136:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869052.195188:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939684480:0@lo:38:kworker.0 00000100:00100000:2.0:1787869052.195289:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869052.195311:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939684608:0@lo:8:kworker.0 00000400:00000100:2.0:1787869052.195348:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939684608 offset 0 length 520: 4 00000100:00100000:2.0:1787869052.195362:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939684736:0@lo:8:kworker.0 00000400:00000100:2.0:1787869052.195379:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939684736 offset 0 length 520: 4 00000100:00100000:2.0:1787869052.195419:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939684480 00000100:00100000:2.0:1787869052.195426:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939684480 00000100:00100000:2.0:1787869052.195460:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787869052.195469:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939684480:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787869052.195485:0:22660:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787869052.195532:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939684480:12345-0@lo:38:kworker.0 Request processed in 63us (243us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787869052.195539:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787869052.195573:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da86347800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787869052.195577:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787869052.195580:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939684480:0@lo:38:kworker.0 00000100:00100000:1.0:1787869052.195675:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939684352 00000100:00100000:1.0:1787869052.195680:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939684352 00000100:00100000:1.0:1787869052.195712:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787869052.195720:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:3639:x1874715939684352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869052.195779:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:3639:x1874715939684352:12345-0@lo:400:kworker.0 Request processed in 48us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869052.195785:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787869052.195956:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00000100:00100000:1.0:1787869052.195961:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939684352:0@lo:400:kworker.0 00000100:00100000:0.0:1787869052.196028:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939684864 00000100:00100000:0.0:1787869052.196032:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939684864 00000100:00100000:0.0:1787869052.196058:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787869052.196065:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939684864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869052.196102:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939684864:12345-0@lo:400:kworker.0 Request processed in 38us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869052.196109:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787869052.196129:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93dab6f552c0 x1874715939684864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787869052.196141:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939684864:0@lo:400:kworker.0 00010000:00010000:0.0:1787869052.772916:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869053.221362:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00010000:00010000:3.0:1787869053.793425:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787869054.178571:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787869054.241310:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00010000:00010000:0.0:1787869054.817562:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869055.265264:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00010000:00010000:3.0:1787869055.842335:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869056.292375:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00010000:00010000:0.0:1787869056.866359:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787869057.313501:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787869057.313508:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787869057.313512:0:8:0:(import.c:65:import_set_state_nolock()) ffff93da86347800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787869057.313519:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 676 00000100:00080000:3.0:1787869057.313525:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787869057.313532:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93da86347800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787869057.313554:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9888c2580 x1874715939685120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787869057.313624:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787869057.313628:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787869057.313631:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787869057.313634:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787869057.313707:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939685248:0@lo:400:kworker.0 00000100:00100000:1.0:1787869057.313789:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869057.313849:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787869057.313855:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3637:1874715939684992:0@lo:400:kworker.0 00000100:00100000:1.0:1787869057.313893:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869057.313929:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939684992 00000100:00100000:1.0:1787869057.313935:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939684992 00000100:00100000:1.0:1787869057.313973:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787869057.313980:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:3637:x1874715939684992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869057.314022:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:3637:x1874715939684992:12345-0@lo:400:kworker.0 Request processed in 42us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869057.314028:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787869057.314075:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3637:1874715939684992:0@lo:400:kworker.0 00000100:00100000:3.0:1787869057.314364:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939685248 00000100:00100000:3.0:1787869057.314370:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939685248 00000100:00100000:3.0:1787869057.314411:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787869057.314417:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939685248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787869057.314459:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939685248:12345-0@lo:400:kworker.0 Request processed in 42us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869057.314465:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787869057.314498:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d9888c03c0 x1874715939685248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869057.314511:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939685248:0@lo:400:kworker.0 00000100:00100000:2.0:1787869057.314685:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00000100:00100000:0.0:1787869057.317840:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939685120:0@lo:38:kworker.0 00000100:00100000:0.0:1787869057.317926:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869057.318196:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939685120 00000100:00100000:2.0:1787869057.318206:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939685120 00000100:00100000:2.0:1787869057.318247:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787869057.318254:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939685120:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787869057.318273:0:22660:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787869057.318334:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939685120:12345-0@lo:38:kworker.0 Request processed in 68us (396us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787869057.318341:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787869057.318559:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da86347800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787869057.318565:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787869057.318569:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939685120:0@lo:38:kworker.0 00000020:01000004:3.0:1787869057.323597:0:23386:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787869057.323601:0:23386:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787869057.323602:0:23386:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787869057.323730:0:23386:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93da88303000 00000020:01000004:3.0:1787869057.323749:0:23386:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787869057.323761:0:23386:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787869057.323787:0:23386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff93daaf710000) 00000020:00000080:3.0:1787869057.323803:0:23386:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787869057.440610:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1787869057.441493:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787869057.444540:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787869057.444823:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1787869057.445307:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1787869057.445707:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787869057.446444:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1787869057.446650:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1787869057.446862:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1787869057.447193:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787869057.447386:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1787869057.447723:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1787869057.448311:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787869057.448525:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1787869057.448748:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787869057.449059:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1787869057.449417:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787869057.449608:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1787869057.449843:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1787869057.452088:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787869057.452745:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787869057.453174:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1787869057.453521:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787869057.453831:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1787869057.454091:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787869057.455285:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1787869057.455909:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787869057.456350:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787869057.456606:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1787869057.457380:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787869057.457683:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787869057.458026:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787869057.458339:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787869057.458546:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1787869057.460530:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787869057.462957:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1787869057.467528:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787869057.473377:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787869057.473895:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787869057.474117:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787869057.474391:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787869057.474567:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787869057.474753:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1787869057.474985:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787869057.475258:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787869057.475576:0:23386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:1.0:1787869057.477356:0:23386:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787869057.477577:0:23386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787869057.477590:0:23386:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787869057.477602:0:23386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2eb58 00000020:01000004:1.0:1787869057.477609:0:23386:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787869057.477629:0:23386:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787869057.477633:0:23386:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787869057.477638:0:23386:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787869057.477661:0:23386:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787869057.477678:0:23386:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787869057.484652:0:23386:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787869057.484705:0:23386:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787869057.484710:0:23386:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787869057.484712:0:23386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787869057.484713:0:23386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787869057.484714:0:23386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787869057.484715:0:23386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787869057.484717:0:23386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787869057.484718:0:23386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787869057.484720:0:23386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787869057.484721:0:23386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787869057.484725:0:23386:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787869057.484727:0:23386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787869057.484728:0:23386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787869057.484730:0:23386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787869057.484730:0:23386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787869057.484732:0:23386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787869057.484733:0:23386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787869057.484739:0:23386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787869057.484740:0:23386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787869057.484741:0:23386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787869057.484825:0:23386:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787869057.484848:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939685376:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787869057.485039:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869057.485259:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18ba840 going to sleep for 11 seconds 00000100:00100000:2.0:1787869057.485380:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939685376 00000100:00100000:2.0:1787869057.485388:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939685376 00000100:00100000:2.0:1787869057.485475:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787869057.485485:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:23386:x1874715939685376:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787869057.485528:0:22649:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787869057.485531:0:22649:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1787869057.485538:0:22649:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787869057.485857:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:23386:x1874715939685376:12345-0@lo:253:mount.lustre.0 Request processed in 373us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869057.485865:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787869057.485962:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939685376:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787869057.485973:0:23386:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787869057.485975:0:23386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787869057.485983:0:23386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787869057.485984:0:23386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787869057.485985:0:23386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787869057.485987:0:23386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787869057.485988:0:23386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787869057.485989:0:23386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787869057.485991:0:23386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787869057.485992:0:23386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787869057.486011:0:23386:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93da88303000 from lustre-MDT0001 10000000:01000000:3.0:1787869057.486040:0:23386:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787869057.486043:0:23386:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787869057.486049:0:23386:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93dabd2f9a48 local copy 00010000:00010000:3.0:1787869057.486059:0:23386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea55 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869057.486173:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939685504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787869057.486203:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.486621:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da921dfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787869057.486699:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939685504 00000100:00100000:1.0:1787869057.486705:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939685504 00000100:00100000:1.0:1787869057.486735:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787869057.486743:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:23386:x1874715939685504:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787869057.486841:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:23386:x1874715939685504:12345-0@lo:501:mount.lustre.0 Request processed in 97us (635us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787869057.486848:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787869057.487040:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939685504:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787869057.487054:0:23386:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787869057.487072:0:23386:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787869057.487078:0:23386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea55 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.487088:0:23386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea55 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869057.487130:0:23386:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93da88303000 10000000:01000000:3.0:1787869057.487135:0:23386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787869057.487140:0:23386:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93dabd2f9a48 10000000:01000000:3.0:1787869057.487142:0:23386:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787869057.487182:0:23386:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93dabd2f9a48 from 1 10000000:01000000:3.0:1787869057.487185:0:23386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787869057.487212:0:23386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eb5f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.487221:0:23386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eb5f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.487229:0:23386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eb5f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869057.487242:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939685632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787869057.487270:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.487284:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da921dfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787869057.487592:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939685632 00000100:00100000:1.0:1787869057.487597:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939685632 00000100:00100000:1.0:1787869057.487616:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787869057.487623:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+12:23386:x1874715939685632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787869057.487632:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787869057.487648:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2eb66 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2eb5f expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.487678:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2eb66 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eb5f expref: 13 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.487688:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1b400/0x2f11f4d3bde2eb66 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eb5f expref: 13 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.487696:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1b400, rc 0) 00000100:00100000:1.0:1787869057.487726:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+13:23386:x1874715939685632:12345-0@lo:101:mount.lustre.0 Request processed in 103us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869057.487739:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787869057.487859:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939685632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787869057.487872:0:23386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eb5f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb66 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.487962:0:23386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eb5f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2eb66 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869057.487981:0:23386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787869057.487994:0:23386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eb5f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb66 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.488001:0:23386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd871400/0x2f11f4d3bde2eb5f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb66 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869057.488009:0:23386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93da88303000 10000000:01000000:3.0:1787869057.488018:0:23386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787869057.488021:0:23386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93da88303000 from 1 10000000:01000000:3.0:1787869057.488023:0:23386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787869057.488039:0:23386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870600/0x2f11f4d3bde2eb6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.488046:0:23386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd870600/0x2f11f4d3bde2eb6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.488053:0:23386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd870600/0x2f11f4d3bde2eb6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869057.488066:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939685760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787869057.488090:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.488198:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da921dfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787869057.488278:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939685760 00000100:00100000:1.0:1787869057.488283:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939685760 00000100:00100000:1.0:1787869057.488302:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787869057.488308:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+13:23386:x1874715939685760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787869057.488315:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787869057.488324:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1a800/0x2f11f4d3bde2eb74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2eb6d expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.488337:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1a800/0x2f11f4d3bde2eb74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eb6d expref: 14 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.488346:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1a800/0x2f11f4d3bde2eb74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eb6d expref: 14 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.488352:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1a800, rc 0) 00000100:00100000:1.0:1787869057.488379:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+14:23386:x1874715939685760:12345-0@lo:101:mount.lustre.0 Request processed in 71us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869057.488385:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787869057.488473:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939685760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787869057.488483:0:23386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd870600/0x2f11f4d3bde2eb6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb74 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.488491:0:23386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd870600/0x2f11f4d3bde2eb6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2eb74 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869057.488500:0:23386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787869057.488512:0:23386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870600/0x2f11f4d3bde2eb6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb74 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.488519:0:23386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd870600/0x2f11f4d3bde2eb6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb74 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869057.488525:0:23386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787869057.488534:0:23386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787869057.488538:0:23386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93da88303000 10000000:01000000:3.0:1787869057.488540:0:23386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787869057.488543:0:23386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787869057.488546:0:23386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787869057.488558:0:23386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2eb7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.488565:0:23386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2eb7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.488572:0:23386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2eb7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869057.488583:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939685888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787869057.488604:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.488620:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da921dfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787869057.488677:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939685888 00000100:00100000:2.0:1787869057.488682:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939685888 00000100:00100000:2.0:1787869057.488702:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787869057.488708:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+14:23386:x1874715939685888:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787869057.488714:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869057.488722:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab52a4c00/0x2f11f4d3bde2eb82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2eb7b expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869057.488735:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab52a4c00/0x2f11f4d3bde2eb82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eb7b expref: 15 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869057.488743:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab52a4c00/0x2f11f4d3bde2eb82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eb7b expref: 15 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869057.488750:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a4c00, rc 0) 00000100:00100000:2.0:1787869057.488790:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+15:23386:x1874715939685888:12345-0@lo:101:mount.lustre.0 Request processed in 82us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869057.488796:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787869057.488862:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939685888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787869057.488872:0:23386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2eb7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb82 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.488879:0:23386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2eb7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2eb82 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787869057.490268:0:23386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1787869057.490780:0:23386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787869057.500905:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787869057.500968:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1787869057.500983:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1787869057.500996:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1787869057.501022:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1787869057.501034:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1787869057.501047:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1787869057.501060:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1787869057.501073:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1787869057.501086:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1787869057.501111:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1787869057.501126:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1787869057.501136:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1787869057.501147:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1787869057.501211:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1787869057.501230:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1787869057.501243:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1787869057.501253:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1787869057.501265:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1787869057.501277:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1787869057.501289:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1787869057.501302:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1787869057.501314:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1787869057.501329:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1787869057.501343:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1787869057.501356:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1787869057.501369:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1787869057.501379:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1787869057.501391:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1787869057.501405:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1787869057.501416:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1787869057.501426:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1787869057.501437:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1787869057.501450:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1787869057.501461:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1787869057.501473:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1787869057.501485:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1787869057.501507:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1787869057.501520:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1787869057.501533:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1787869057.501545:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1787869057.501560:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1787869057.501573:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1787869057.501587:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1787869057.501609:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1787869057.501614:0:23386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1787869057.501729:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939686016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787869057.501790:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.501826:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da921df780 going to sleep for 11 seconds 00000100:00100000:2.0:1787869057.502069:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939686016 00000100:00100000:2.0:1787869057.502076:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939686016 00000100:00100000:2.0:1787869057.502136:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787869057.502146:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+15:23386:x1874715939686016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787869057.502311:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+15:23386:x1874715939686016:12345-0@lo:501:mount.lustre.0 Request processed in 167us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869057.502319:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787869057.503906:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939686016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787869057.503967:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939686144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787869057.504034:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.504073:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da921df780 going to sleep for 11 seconds 00000100:00100000:0.0:1787869057.504457:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939686144 00000100:00100000:0.0:1787869057.504464:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939686144 00000100:00100000:0.0:1787869057.504516:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787869057.504526:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+15:23386:x1874715939686144:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787869057.505639:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+15:23386:x1874715939686144:12345-0@lo:503:mount.lustre.0 Request processed in 1110us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869057.505649:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787869057.505751:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939686144:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787869057.506247:0:23386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787869057.506320:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939686272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787869057.506434:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.506803:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da921dfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787869057.509815:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939686272 00000100:00100000:0.0:1787869057.509829:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939686272 00000100:00100000:0.0:1787869057.510853:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787869057.510871:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+15:23386:x1874715939686272:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787869057.512636:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+15:23386:x1874715939686272:12345-0@lo:502:mount.lustre.0 Request processed in 1766us (6195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869057.512659:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787869057.512776:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939686272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787869057.512993:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787869057.513025:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1787869057.513044:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1787869057.513060:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1787869057.513073:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1787869057.513111:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1787869057.513129:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1787869057.513142:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1787869057.513188:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1787869057.513205:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1787869057.513218:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1787869057.513235:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1787869057.513248:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1787869057.513261:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1787869057.513275:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1787869057.513288:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1787869057.513300:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1787869057.513313:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1787869057.513330:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1787869057.513344:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1787869057.513357:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1787869057.513372:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1787869057.513386:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1787869057.513402:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1787869057.513416:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1787869057.513431:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1787869057.513446:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1787869057.513459:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1787869057.513470:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1787869057.513482:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1787869057.513494:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1787869057.513507:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1787869057.513523:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1787869057.513537:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1787869057.513550:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1787869057.513563:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1787869057.513577:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1787869057.513589:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1787869057.513615:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1787869057.513629:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1787869057.513644:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1787869057.513658:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1787869057.513685:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1787869057.513700:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1787869057.513738:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939686400:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787869057.513794:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.513829:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da921dfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787869057.514072:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939686400 00000100:00100000:2.0:1787869057.514079:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939686400 00000100:00100000:2.0:1787869057.514284:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787869057.514294:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+15:23386:x1874715939686400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787869057.514421:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+15:23386:x1874715939686400:12345-0@lo:502:mount.lustre.0 Request processed in 129us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869057.514429:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787869057.514542:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939686400:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787869057.514588:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1787869057.514596:0:23386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1787869057.525010:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869057.525027:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869057.525030:0:23390:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787869057.525037:0:23390:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787869057.525041:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787869057.525057:0:23390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff93daaf711a48) 00000020:00000080:3.0:1787869057.525079:0:23390:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1787869057.525087:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787869057.525296:0:23390:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787869057.525304:0:23390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2eb90 00000020:00000080:3.0:1787869057.525550:0:23390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787869057.525555:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869057.525559:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869057.525560:0:23390:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787869057.525563:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869057.525567:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869057.525568:0:23390:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787869057.525572:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787869057.525579:0:23390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff93daaf714ed8) 00000020:00000080:3.0:1787869057.525597:0:23390:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1787869057.525601:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787869057.525603:0:23390:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787869057.525606:0:23390:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787869057.525611:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787869057.525658:0:23390:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93da88303000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787869057.525683:0:23390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff93daaf713490) 00000020:00000080:3.0:1787869057.525693:0:23390:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1787869057.525755:0:23390:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787869057.527310:0:23390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2eba5 00000020:00000080:3.0:1787869057.527470:0:23390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787869057.527480:0:23390:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787869057.534932:0:23390:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2f11f4d3bde2ebac 00080000:01000000:3.0:1787869057.534966:0:23390:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787869057.534975:0:23390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2ebb3 00010000:00010000:2.0:1787869057.623912:0:23390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787869057.624456:0:23390:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1787869057.624744:0:23390:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787869057.627277:0:23390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787869057.627290:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787869057.627296:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787869057.627298:0:23390:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787869057.627301:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787869057.627308:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787869057.627309:0:23390:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787869057.627312:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787869057.627318:0:23390:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:00000080:2.0:1787869057.627344:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787869057.627359:0:23390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff93da86ef9a48) 00000020:00000080:2.0:1787869057.627381:0:23390:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787869057.627387:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787869057.627469:0:23390:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787869057.627475:0:23390:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787869057.627483:0:23390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2ebc1 00010000:00080000:2.0:1787869057.627519:0:23390:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dab5bf3800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:2.0:1787869057.630084:0:23390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1787869057.631449:0:23390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787869057.631464:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787869057.631501:0:23390:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787869057.631524:0:23390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2ebc8 00000100:00080000:3.0:1787869057.631535:0:23390:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787869057.631542:0:23390:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93dab5bf3800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787869057.631579:0:23390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9888c03c0 x1874715939686528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787869057.631647:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939686528:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787869057.631739:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869057.631852:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939686528 00000100:00100000:0.0:1787869057.631860:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939686528 00000100:00100000:0.0:1787869057.631892:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787869057.631901:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3635:x1874715939686528:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787869057.631926:0:22660:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:0.0:1787869057.631970:0:22660:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2ebcf 00000004:00100000:0.0:1787869057.631984:0:22660:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787869057.631990:0:22660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1787869057.632232:0:23390:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1787869057.632306:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869057.632310:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869057.632312:0:23390:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1787869057.632315:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787869057.632318:0:23390:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787869057.632319:0:23390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787869057.632321:0:23390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787869057.632322:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787869057.632328:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869057.632329:0:23390:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787869057.632332:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869057.632336:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869057.632337:0:23390:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1787869057.632341:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787869057.632379:0:23390:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787869057.632396:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869057.632399:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869057.632401:0:23390:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1787869057.632403:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787869057.632405:0:23390:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1787869057.632406:0:23390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787869057.632407:0:23390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787869057.632409:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787869057.632411:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869057.632412:0:23390:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787869057.632415:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787869057.632418:0:23390:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787869057.632421:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869057.632422:0:23390:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787869057.632425:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787869057.632429:0:23390:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:3.0:1787869057.632455:0:23390:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787869057.632458:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787869057.632472:0:23390:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff93d9863d0000) 00000020:00000080:3.0:1787869057.632485:0:23390:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787869057.632491:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787869057.632555:0:23390:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787869057.632562:0:23390:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787869057.632567:0:23390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2ebdd 00010000:00080000:3.0:1787869057.632592:0:23390:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93dab5bc4000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1787869057.632796:0:23390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:1.0:1787869057.633312:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869057.633317:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787869057.633320:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869057.633323:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:01000000:3.0:1787869057.633636:0:23390:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787869057.633893:0:23390:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787869057.635057:0:23390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787869057.635545:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1787869057.635956:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787869057.636378:0:23395:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787869057.636384:0:23395:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787869057.637635:0:23390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787869057.637648:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787869057.637703:0:23390:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787869057.637732:0:23390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2ebe4 00000100:00080000:1.0:1787869057.637743:0:23390:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787869057.637749:0:23390:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93dab5bc4000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787869057.637786:0:23390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dabed0a1c0 x1874715939686656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787869057.637844:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939686656:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787869057.637903:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939686656 offset 0 length 520: 4 00000100:00080000:1.0:1787869057.637961:0:23390:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787869057.638022:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787869057.638026:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787869057.638028:0:23390:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787869057.638031:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787869057.638034:0:23390:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787869057.638036:0:23390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787869057.638037:0:23390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787869057.638039:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787869057.638041:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787869057.638042:0:23390:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787869057.638045:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787869057.638049:0:23390:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787869057.638052:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787869057.638053:0:23390:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787869057.638057:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787869057.638060:0:23390:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.127@tcp to nid 0x20000c0a8cc7f (192.168.204.127@tcp) 00000020:01000000:1.0:1787869057.638084:0:23390:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787869057.638086:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787869057.638109:0:23390:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff93dabc0bced8) 00000020:00000080:1.0:1787869057.638123:0:23390:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1787869057.638127:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787869057.638213:0:23390:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787869057.638220:0:23390:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787869057.638225:0:23390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2f11f4d3bde2ebf2 00010000:00080000:1.0:1787869057.638254:0:23390:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93da88341000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:1.0:1787869057.638452:0:23390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787869057.638520:0:23390:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787869057.638536:0:23390:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1787869057.638710:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787869057.638716:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787869057.638719:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787869057.638722:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787869057.639554:0:22660:0:(import.c:65:import_set_state_nolock()) ffff93daa072d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787869057.639659:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3635:x1874715939686528:12345-0@lo:38:llog_process_th.0 Request processed in 7756us (7918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869057.639683:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787869057.640109:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787869057.640120:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787869057.640128:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787869057.640133:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787869057.640136:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab5bf3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787869057.640268:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939686784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787869057.640286:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939686528:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787869057.640311:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869057.640349:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939686784 00000100:00100000:2.0:1787869057.640355:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939686784 00000100:00100000:2.0:1787869057.640401:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787869057.640411:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939686784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787869057.640557:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787869057.640606:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1874715939686784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 198us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869057.640613:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787869057.640692:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939686784:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787869057.641304:0:23390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787869057.641530:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1787869057.641699:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1787869057.642392:0:23397:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787869057.642398:0:23397:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787869057.643063:0:23390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787869057.643076:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787869057.645540:0:23390:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787869057.645574:0:23390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2ebf9 00000100:00080000:0.0:1787869057.645587:0:23390:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787869057.645594:0:23390:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93da88341000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787869057.645635:0:23390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab6f552c0 x1874715939686912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787869057.645736:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939686912:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787869057.645822:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939686912 offset 0 length 520: 4 00000100:00080000:0.0:1787869057.646050:0:23390:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787869057.646140:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787869057.646147:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869057.646149:0:23390:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787869057.646176:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787869057.646183:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869057.646184:0:23390:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787869057.646188:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787869057.646189:0:23390:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787869057.646191:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787869057.646194:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869057.646195:0:23390:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787869057.646197:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787869057.646199:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869057.646200:0:23390:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787869057.646204:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787869057.646236:0:23390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787869057.646240:0:23390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869057.646242:0:23390:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787869057.646245:0:23390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:0.0:1787869057.646297:0:23386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1787869057.646325:0:23386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787869057.646340:0:23386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2eb7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb82 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869057.646351:0:23386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd870e00/0x2f11f4d3bde2eb7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eb82 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787869057.646360:0:23386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93da88303000 from 1 10000000:01000000:0.0:1787869057.646363:0:23386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787869057.646390:0:23386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869057.646404:0:23386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869057.646416:0:23386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869057.646433:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787869057.646473:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869057.646488:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93b12180 going to sleep for 11 seconds 00000100:00100000:2.0:1787869057.646677:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939687040 00000100:00100000:2.0:1787869057.646684:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939687040 00000100:00100000:2.0:1787869057.646734:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787869057.646745:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+15:23386:x1874715939687040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787869057.646772:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869057.646786:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ec00 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869057.646821:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec00 expref: 16 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869057.646832:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec00 expref: 16 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869057.646840:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a5a00, rc 0) 00000100:00100000:2.0:1787869057.646880:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+16:23386:x1874715939687040:12345-0@lo:101:mount.lustre.0 Request processed in 137us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869057.646887:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787869057.647100:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787869057.647114:0:23386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec07 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869057.647122:0:23386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ec07 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869057.647699:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687168:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787869057.647741:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869057.647827:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939687168 00000100:00100000:1.0:1787869057.647832:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939687168 00000100:00100000:1.0:1787869057.647864:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787869057.647871:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+16:23386:x1874715939687168:12345-0@lo:256:mount.lustre.0 00000100:00080000:3.0:1787869057.648018:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787869057.648024:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787869057.648026:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787869057.648029:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787869057.648079:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93b12180 going to sleep for 11 seconds 20000000:01000000:1.0:1787869057.648329:0:22648:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787869057.648346:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787869057.648350:0:22648:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1787869057.648447:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+16:23386:x1874715939687168:12345-0@lo:256:mount.lustre.0 Request processed in 576us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869057.648455:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787869057.648534:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687168:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787869057.649756:0:23386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787869057.649946:0:23386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec07 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869057.649959:0:23386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec07 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787869057.650021:0:23386:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93da88303000 from 1 10000000:01000000:0.0:1787869057.650024:0:23386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787869057.650056:0:23386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869057.650063:0:23386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869057.650072:0:23386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869057.650091:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687296:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787869057.650341:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869057.650383:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da93b12180 going to sleep for 11 seconds 00000100:00100000:1.0:1787869057.650431:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939687296 00000100:00100000:1.0:1787869057.650439:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939687296 00000100:00100000:1.0:1787869057.650513:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787869057.650523:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+16:23386:x1874715939687296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787869057.650536:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787869057.650554:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2ec15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ec0e expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.650577:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2ec15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec0e expref: 17 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.650593:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2ec15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec0e expref: 17 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.650602:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1a200, rc 0) 00000100:00100000:1.0:1787869057.650653:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:23386:x1874715939687296:12345-0@lo:101:mount.lustre.0 Request processed in 132us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869057.650660:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787869057.650881:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787869057.650897:0:23386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec15 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869057.650905:0:23386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ec15 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787869057.652425:0:23386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1787869057.652720:0:23386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787869057.653042:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787869057.653066:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1787869057.653081:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1787869057.653285:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1787869057.653305:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1787869057.653317:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1787869057.653330:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1787869057.653343:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1787869057.653355:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787869057.653366:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1787869057.653379:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1787869057.653397:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1787869057.653402:0:23386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1787869057.653483:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787869057.653545:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869057.653645:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18ba300 going to sleep for 11 seconds 00000100:00100000:2.0:1787869057.653696:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939687424 00000100:00100000:2.0:1787869057.653702:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939687424 00000100:00100000:2.0:1787869057.653897:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787869057.653908:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:23386:x1874715939687424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787869057.654065:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:23386:x1874715939687424:12345-0@lo:501:mount.lustre.0 Request processed in 159us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869057.654073:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787869057.654279:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787869057.654312:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787869057.654365:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869057.654420:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18ba300 going to sleep for 11 seconds 00000100:00100000:2.0:1787869057.654467:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939687552 00000100:00100000:2.0:1787869057.654471:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939687552 00000100:00100000:2.0:1787869057.654504:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787869057.654511:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:23386:x1874715939687552:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787869057.654627:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:23386:x1874715939687552:12345-0@lo:503:mount.lustre.0 Request processed in 116us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869057.654633:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787869057.654867:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687552:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787869057.655390:0:23386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787869057.655469:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869057.655511:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869057.655576:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da82c47e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787869057.655612:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939687680 00000100:00100000:2.0:1787869057.655618:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939687680 00000100:00100000:2.0:1787869057.655708:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787869057.655717:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:23386:x1874715939687680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787869057.655957:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:23386:x1874715939687680:12345-0@lo:502:mount.lustre.0 Request processed in 241us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869057.655964:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787869057.656049:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787869057.656257:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787869057.656284:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1787869057.656299:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1787869057.656311:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1787869057.656325:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1787869057.656338:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1787869057.656353:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1787869057.656365:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1787869057.656377:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787869057.656389:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1787869057.656403:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1787869057.656426:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869057.656463:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869057.656482:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa18ba300 going to sleep for 11 seconds 00000100:00100000:0.0:1787869057.656608:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939687808 00000100:00100000:0.0:1787869057.656613:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939687808 00000100:00100000:0.0:1787869057.656638:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787869057.656645:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:23386:x1874715939687808:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787869057.656740:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:23386:x1874715939687808:12345-0@lo:502:mount.lustre.0 Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869057.656769:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787869057.656970:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787869057.657008:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1787869057.657016:0:23386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787869057.657749:0:23399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787869057.657874:0:23399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869057.657877:0:23399:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787869057.657885:0:23399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93da88303000 00000020:00000080:0.0:1787869057.657887:0:23399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787869057.657895:0:23399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787869057.657897:0:23399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869057.657899:0:23399:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787869057.657901:0:23399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787869057.657904:0:23399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869057.657905:0:23399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787869057.657908:0:23399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93da88303000 00000020:00000080:0.0:1787869057.657910:0:23399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787869057.658004:0:23399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787869057.658008:0:23399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869057.658009:0:23399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787869057.658012:0:23399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787869057.658015:0:23399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869057.658016:0:23399:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787869057.658020:0:23399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93da88303000 00000020:00000080:0.0:1787869057.658022:0:23399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787869057.665103:0:23399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787869057.665118:0:23399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869057.665121:0:23399:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787869057.665126:0:23399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787869057.665130:0:23399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869057.665131:0:23399:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787869057.665135:0:23399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93da88303000 00000020:00000080:0.0:1787869057.665137:0:23399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787869057.665221:0:23399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787869057.665224:0:23399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869057.665230:0:23399:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787869057.665234:0:23399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1787869057.666220:0:23386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787869057.666257:0:23386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787869057.666281:0:23386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec15 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.666293:0:23386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec15 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869057.666351:0:23386:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787869057.666354:0:23386:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93da88303000 10000000:01000000:3.0:1787869057.666357:0:23386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93da88303000 10000000:01000000:3.0:1787869057.666362:0:23386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787869057.666368:0:23386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93da88303000 from 1 10000000:01000000:3.0:1787869057.666371:0:23386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787869057.666407:0:23386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2ec1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.666424:0:23386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2ec1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.666436:0:23386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2ec1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869057.666462:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687936:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787869057.666531:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.666573:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939687936 00000100:00100000:3.0:1787869057.666580:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939687936 00000100:00100000:3.0:1787869057.666624:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787869057.666633:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:23386:x1874715939687936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787869057.666646:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869057.666658:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870a00/0x2f11f4d3bde2ec23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ec1c expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.666693:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870a00/0x2f11f4d3bde2ec23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec1c expref: 18 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.666705:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870a00/0x2f11f4d3bde2ec23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec1c expref: 18 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.666713:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870a00, rc 0) 00000100:00100000:3.0:1787869057.666745:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:23386:x1874715939687936:12345-0@lo:101:mount.lustre.0 Request processed in 113us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869057.667151:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787869057.667216:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9162ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787869057.667240:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939687936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787869057.667254:0:23386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2ec1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec23 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869057.667264:0:23386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2ec1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ec23 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787869057.670082:0:23386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1787869057.672009:0:23386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787869057.672308:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1787869057.672334:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1787869057.672365:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1787869057.672380:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1787869057.672392:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1787869057.672405:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1787869057.672418:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1787869057.672431:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1787869057.672445:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1787869057.672458:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1787869057.672470:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1787869057.672481:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1787869057.672494:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1787869057.672507:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1787869057.672521:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1787869057.672532:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1787869057.672544:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1787869057.672558:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1787869057.672585:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1787869057.672599:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1787869057.672611:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1787869057.672622:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1787869057.672645:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1787869057.672659:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1787869057.672688:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1787869057.672702:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1787869057.672715:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1787869057.672728:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1787869057.672741:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1787869057.674649:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1787869057.674714:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1787869057.674731:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1787869057.674745:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1787869057.675282:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1787869057.675319:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1787869057.675336:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1787869057.675358:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1787869057.675371:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1787869057.675384:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1787869057.675398:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1787869057.675413:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1787869057.676237:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1787869057.676262:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1787869057.676276:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1787869057.676288:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1787869057.676299:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1787869057.676311:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1787869057.676323:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1787869057.676472:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1787869057.676499:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1787869057.676514:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1787869057.676519:0:23386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1787869057.676616:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939688064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787869057.676688:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.676740:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9162f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787869057.677199:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939688064 00000100:00100000:0.0:1787869057.677206:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939688064 00000100:00100000:0.0:1787869057.677253:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787869057.677262:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:23386:x1874715939688064:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787869057.677384:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:23386:x1874715939688064:12345-0@lo:501:mount.lustre.0 Request processed in 122us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869057.677391:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787869057.678911:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939688064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787869057.678953:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939688192:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787869057.679004:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.679037:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9162f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787869057.681088:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939688192 00000100:00100000:1.0:1787869057.681175:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939688192 00000100:00100000:1.0:1787869057.681228:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787869057.681237:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:23386:x1874715939688192:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787869057.681369:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:23386:x1874715939688192:12345-0@lo:503:mount.lustre.0 Request processed in 133us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869057.681376:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787869057.681912:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939688192:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787869057.683470:0:23386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787869057.683562:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939688320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787869057.683633:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.683697:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939688320 00000100:00100000:3.0:1787869057.683703:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939688320 00000100:00100000:3.0:1787869057.683745:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787869057.686188:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:23386:x1874715939688320:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787869057.686335:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:23386:x1874715939688320:12345-0@lo:502:mount.lustre.0 Request processed in 2581us (2701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869057.686343:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787869057.686407:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9162ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787869057.686428:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939688320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787869057.686609:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1787869057.686636:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1787869057.686647:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1787869057.686658:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1787869057.686683:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1787869057.686694:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1787869057.686705:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1787869057.686715:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1787869057.686734:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1787869057.686744:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1787869057.686755:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1787869057.686765:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1787869057.686787:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1787869057.686799:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1787869057.686809:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1787869057.686820:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1787869057.686830:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1787869057.686840:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1787869057.686850:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1787869057.686860:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1787869057.686870:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1787869057.686880:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1787869057.686891:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1787869057.686901:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1787869057.686912:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1787869057.686922:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1787869057.686932:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1787869057.686943:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1787869057.686961:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1787869057.686973:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1787869057.686983:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1787869057.686992:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1787869057.687003:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1787869057.687013:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1787869057.687023:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1787869057.687034:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1787869057.687044:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1787869057.687054:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1787869057.687064:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1787869057.687074:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1787869057.687084:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1787869057.687115:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1787869057.687126:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1787869057.687136:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1787869057.687174:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1787869057.687188:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1787869057.687199:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1787869057.687209:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1787869057.687246:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939688448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787869057.687291:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.687324:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9162ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787869057.687396:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939688448 00000100:00100000:1.0:1787869057.687402:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939688448 00000100:00100000:1.0:1787869057.687444:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787869057.687451:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:23386:x1874715939688448:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869057.687538:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:23386:x1874715939688448:12345-0@lo:502:mount.lustre.0 Request processed in 86us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869057.687545:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787869057.687597:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939688448:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787869057.687761:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1787869057.687784:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1787869057.687803:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939688576:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869057.687836:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869057.687859:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939688576 00000100:00100000:1.0:1787869057.687863:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939688576 00000100:00100000:1.0:1787869057.687884:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787869057.687890:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:23386:x1874715939688576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869057.687948:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:23386:x1874715939688576:12345-0@lo:502:mount.lustre.0 Request processed in 58us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869057.687954:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787869057.687980:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabede8300 going to sleep for 11 seconds 00000100:00100000:1.0:1787869057.687992:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939688576:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787869057.688026:0:23386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1787869057.688032:0:23386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787869057.690047:0:23404:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787869057.690064:0:23404:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff93d9863d1a48) 00000020:00000080:3.0:1787869057.690085:0:23404:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787869057.690288:0:23404:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93da88303000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787869057.690293:0:23404:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93da88303000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787869057.690295:0:23404:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93da88303000 3 00010000:00080000:3.0:1787869057.690322:0:23404:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93daa05d8800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1787869057.696530:0:23404:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787869057.696782:0:23404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787869057.696822:0:23404:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787869057.696846:0:23404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2f11f4d3bde2ec31 00000100:00080000:3.0:1787869057.696856:0:23404:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787869057.696861:0:23404:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93daa05d8800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787869057.696894:0:23404:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9888c2940 x1874715939688704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787869057.696922:0:23404:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787869057.696945:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787869057.696949:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787869057.696960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787869057.696963:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787869057.697206:0:23404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00100000:1.0:1787869057.697626:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874715939688704:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787869057.697699:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869057.697765:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939688704 00000100:00100000:1.0:1787869057.697771:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939688704 00000100:00100000:1.0:1787869057.697799:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787869057.697805:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1874715939688704:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787869057.697826:0:22656:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:1.0:1787869057.697866:0:22656:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2f11f4d3bde2ec38 00000004:00100000:1.0:1787869057.697879:0:22656:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787869057.697906:0:22656:0:(import.c:65:import_set_state_nolock()) ffff93da88340000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787869057.697947:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874715939688704:12345-0@lo:38:llog_process_th.0 Request processed in 142us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869057.697955:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787869057.697989:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d9888c2940 x1874715939688704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787869067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787869057.697999:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787869057.698006:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1787869057.698012:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787869057.698015:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787869057.698018:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93daa05d8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787869057.698023:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874715939688704:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1787869057.698044:0:23386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787869057.698075:0:23386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787869057.698248:0:23386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2ec1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec23 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.698260:0:23386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd870000/0x2f11f4d3bde2ec1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec23 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787869057.698313:0:23386:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787869057.698315:0:23386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787869057.698316:0:23386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787869057.698317:0:23386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787869057.698318:0:23386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787869057.698319:0:23386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787869057.698320:0:23386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787869057.698322:0:23386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787869057.698324:0:23386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787869057.698327:0:23386:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1787869057.698329:0:23386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787869057.698330:0:23386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787869057.698331:0:23386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787869057.698332:0:23386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787869057.698333:0:23386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787869057.698334:0:23386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787869057.698335:0:23386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787869057.698336:0:23386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787869057.698337:0:23386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787869057.698351:0:23386:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787869057.698362:0:23386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939688832:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787869057.698395:0:23386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869057.698420:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939688832 00000100:00100000:1.0:1787869057.698424:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939688832 00000100:00100000:1.0:1787869057.698453:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787869057.698460:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:23386:x1874715939688832:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787869057.698479:0:22647:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787869057.698491:0:22647:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787869057.699952:0:23386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9872c9a80 going to sleep for 11 seconds 00000001:00100000:1.0:1787869057.703101:0:22634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787869057.703309:0:22647:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787869057.703327:0:22647:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1787869057.703506:0:22670:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787869057.703511:0:22670:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787869057.703533:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.703552:0:22670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dabd871c00/0x2f11f4d3bde2eb43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eb3c expref: 18 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.703560:0:22670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec00 expref: 18 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.703568:0:22670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.703606:0:22670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ec00 expref: 18 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.703620:0:22670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec00 expref: 18 pid: 22649 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869057.703633:0:22670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22670:1874715939688960:0@lo:104: 00000100:00100000:1.0:1787869057.703707:0:22670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787869057.703767:0:22670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dabd871c00/0x2f11f4d3bde2eb43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2eb3c expref: 18 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.703775:0:22670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dabd871c00/0x2f11f4d3bde2eb43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2eb3c expref: 18 pid: 22649 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869057.703783:0:22670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0bc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22670:1874715939689088:0@lo:104: 00000100:00100000:1.0:1787869057.703815:0:22670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869057.703832:0:22670:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9872c9480 going to sleep for 11 seconds 00000100:00100000:1.0:1787869057.703853:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939688960 00000100:00100000:1.0:1787869057.703859:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939688960 00000100:00100000:1.0:1787869057.703894:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939689088 00000100:00100000:1.0:1787869057.703897:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939689088 00000100:00100000:1.0:1787869057.703912:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787869057.703920:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+4:22670:x1874715939688960:12345-0@lo:104: 00010000:00010000:1.0:1787869057.703932:0:22637:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ec07 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.703980:0:22637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787869057.703985:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+4:22670:x1874715939688960:12345-0@lo:104: Request processed in 67us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869057.703992:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787869057.704008:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787869057.704013:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+3:22670:x1874715939689088:12345-0@lo:104: 00010000:00010000:1.0:1787869057.704020:0:22637:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2eb43 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.704049:0:22637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787869057.704054:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+3:22670:x1874715939689088:12345-0@lo:104: Request processed in 42us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869057.704060:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787869057.704075:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787869057.704080:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ec07 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.704088:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1dc00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787869057.704283:0:22642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ec07 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.704292:0:22642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ec07 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787869057.704299:0:22642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ec07 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869057.704306:0:22642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787869057.704333:0:22642:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec07 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.704339:0:22642:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787869057.704357:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec07 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.704364:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93daace1dc00/0x2f11f4d3bde2ec00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec07 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.704378:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869057.704381:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2eb43 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.704386:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1da00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787869057.704389:0:22642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2eb43 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.704395:0:22642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2eb43 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787869057.704410:0:22642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2eb43 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869057.704415:0:22642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787869057.704428:0:22642:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2eb43 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.704434:0:22642:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787869057.704449:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2eb43 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.704456:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93daace1da00/0x2f11f4d3bde2eb3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2eb43 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.704468:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869057.704470:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869057.704471:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869057.704478:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787869057.704488:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939689216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787869057.704516:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869057.704552:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939689344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787869057.704574:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869057.704635:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939689216 00000100:00100000:1.0:1787869057.704639:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939689216 00010000:00010000:1.0:1787869057.704658:0:22640:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec00 expref: 19 pid: 22649 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869057.704689:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939689344 00000100:00100000:1.0:1787869057.704699:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939689344 00010000:00010000:1.0:1787869057.704712:0:22640:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dabd871c00/0x2f11f4d3bde2eb43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2eb3c expref: 20 pid: 22649 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869057.704725:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787869057.704731:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:3639:x1874715939689216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787869057.704740:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787869057.704745:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec00 expref: 20 pid: 22649 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869057.704991:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:23386:x1874715939688832:12345-0@lo:253:mount.lustre.0 Request processed in 6530us (6593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869057.705000:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:1.0:1787869057.706408:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec00 expref: 19 pid: 22649 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.706434:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787869057.706502:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+19:3639:x1874715939689216:12345-0@lo:103:ldlm_bl.0 Request processed in 1771us (1984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869057.706512:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787869057.706536:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787869057.706545:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed08b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:3636:x1874715939689344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787869057.706559:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787869057.706565:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dabd871c00/0x2f11f4d3bde2eb43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2eb3c expref: 18 pid: 22649 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.706574:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dabd871c00/0x2f11f4d3bde2eb43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2eb3c expref: 18 pid: 22649 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.706586:0:22640:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.706595:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787869057.706616:0:22640:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003106206s 00010000:00010000:1.0:1787869057.706621:0:22640:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.706627:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.706633:0:22640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.706639:0:22640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.706645:0:22640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ac00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869057.706649:0:22640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.706656:0:22640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.706677:0:22640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869057.706687:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787869057.706719:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed08b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:3636:x1874715939689344:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869057.706725:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787869057.706902:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939689216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787869057.708169:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec00 expref: 17 pid: 22649 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869057.708184:0:22670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22670:1874715939688960:0@lo:104: 00010000:00010000:2.0:1787869057.708198:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd871c00/0x2f11f4d3bde2eb43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2eb3c expref: 16 pid: 22649 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869057.708206:0:22670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0bc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22670:1874715939689088:0@lo:104: 00010000:00010000:2.0:1787869057.708227:0:22670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869057.708236:0:22670:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869057.708242:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869057.708248:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ec3f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869057.708278:0:23386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:23386:1874715939688832:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787869057.708290:0:23386:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787869057.708299:0:23386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787869057.708302:0:23386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787869057.708303:0:23386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787869057.708304:0:23386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787869057.708306:0:23386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787869057.708307:0:23386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787869057.708308:0:23386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787869057.708310:0:23386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787869057.708312:0:23386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787869057.708326:0:23386:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787869057.708990:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939689344:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1787869057.719670:0:23386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1787869057.719948:0:23409:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787869057.719964:0:23409:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787869057.720581:0:23411:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787869057.720973:0:23386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1787869057.721436:0:23411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1787869057.721980:0:23386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787869057.722018:0:23386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787869057.722476:0:23386:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787869057.722483:0:23386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787869057.722520:0:23386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787869057.723484:0:23386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787869057.724014:0:23386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787869057.724045:0:23386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1787869057.724141:0:23386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787869057.724644:0:23386:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:2.0:1787869057.730016:0:23411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787869057.730087:0:23411:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1787869057.730877:0:23412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23412:1874715939689472:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787869057.731766:0:23412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.732407:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939689472 00000100:00100000:3.0:1787869057.732415:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939689472 00000100:00100000:3.0:1787869057.732624:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787869057.732635:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23412:x1874715939689472:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787869057.732740:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23412:x1874715939689472:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 107us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869057.732747:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787869057.732773:0:23412:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9882e5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787869057.732799:0:23412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23412:1874715939689472:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1787869057.732857:0:23412:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000001:00000004:3.0:1787869057.733287:0:23386:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1787869057.733698:0:23412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23412:1874715939689600:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787869057.733763:0:23412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.733789:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939689600 00000100:00100000:3.0:1787869057.733794:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939689600 00000100:00100000:3.0:1787869057.733836:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787869057.733845:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23412:x1874715939689600:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787869057.733976:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23412:x1874715939689600:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 133us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869057.733984:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787869057.734147:0:23412:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc119480 going to sleep for 11 seconds 00000100:00100000:3.0:1787869057.734182:0:23412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23412:1874715939689600:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787869057.734272:0:23412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23412:1874715939689728:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787869057.734302:0:23412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869057.734360:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939689728 00000100:00100000:2.0:1787869057.734365:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939689728 00000100:00100000:3.0:1787869057.734380:0:23412:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5bdb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787869057.734393:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787869057.734400:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23412:x1874715939689728:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787869057.734455:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23412:x1874715939689728:12345-0@lo:900:lod0001_rec0000.0 Request processed in 56us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869057.734461:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787869057.734795:0:23412:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d9888c0780 x1874715939689728/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787869073 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869057.734807:0:23412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23412:1874715939689728:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787869057.734852:0:23412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23412:1874715939689856:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787869057.734877:0:23412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869057.734897:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939689856 00000100:00100000:3.0:1787869057.734900:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939689856 00000100:00100000:3.0:1787869057.734921:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787869057.734927:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23412:x1874715939689856:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787869057.734969:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23412:x1874715939689856:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 43us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869057.734976:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787869057.734996:0:23412:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc119d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787869057.735008:0:23412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23412:1874715939689856:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787869057.735044:0:23412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787869057.735378:0:23386:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787869057.735401:0:23386:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa3fe456ab988 00100000:10000000:3.0:1787869057.735409:0:23386:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1787869057.736276:0:23386:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787869057.736306:0:23386:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787869057.736324:0:23386:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787869057.736343:0:23386:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787869057.738351:0:23386:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787869057.738599:0:23386:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1787869057.741609:0:23412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787869057.741691:0:23412:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787869057.741697:0:23412:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1787869057.890763:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869058.337320:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00000040:00080000:3.0:1787869058.721986:0:23410:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787869058.926717:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787869059.362133:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 10000000:01000000:1.0:1787869059.553268:0:22651:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787869059.553276:0:22651:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93da88303000 from 12 10000000:01000000:1.0:1787869059.553282:0:22651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787869059.553336:0:22651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869059.553348:0:22651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869059.553359:0:22651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869059.553385:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939689984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787869059.553472:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869059.553576:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9872c9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787869059.556821:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939689984 00000100:00100000:3.0:1787869059.556836:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939689984 00000100:00100000:3.0:1787869059.558290:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787869059.558308:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+16:22651:x1874715939689984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787869059.558326:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869059.558347:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ec4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ec46 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869059.558377:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ec4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec46 expref: 17 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869059.558388:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ec4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec46 expref: 17 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869059.558397:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870800, rc 0) 00000100:00100000:3.0:1787869059.558556:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:22651:x1874715939689984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (5083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869059.558564:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787869059.564946:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939689984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787869059.564980:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec4d expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869059.565002:0:22651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ec4d expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869059.565077:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939690112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787869059.565148:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869059.565223:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da84fc4840 going to sleep for 11 seconds 00000100:00100000:1.0:1787869059.565313:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939690112 00000100:00100000:1.0:1787869059.565322:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939690112 00000100:00100000:1.0:1787869059.565371:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787869059.565380:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:22651:x1874715939690112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787869059.565402:0:22647:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787869059.565418:0:22647:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787869059.565421:0:22647:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1787869059.565513:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:22651:x1874715939690112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869059.565522:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787869059.565792:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939690112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787869059.565837:0:22651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787869059.565844:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec4d expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869059.565854:0:22651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec4d expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787869059.565865:0:22651:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787869059.565867:0:22651:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93dab523f000 from 12 10000000:01000000:2.0:1787869059.565870:0:22651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787869059.565894:0:22651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869059.565902:0:22651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869059.565911:0:22651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869059.565925:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939690240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787869059.565961:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869059.566024:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da84fc4840 going to sleep for 11 seconds 00000100:00100000:1.0:1787869059.570869:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939690240 00000100:00100000:1.0:1787869059.570883:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939690240 00000100:00100000:1.0:1787869059.570948:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787869059.570958:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:22651:x1874715939690240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787869059.570983:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787869059.571001:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2ec5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ec54 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869059.571027:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2ec5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec54 expref: 18 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869059.571037:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2ec5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec54 expref: 18 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869059.571047:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1be00, rc 0) 00000100:00100000:1.0:1787869059.571119:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:22651:x1874715939690240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (5156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869059.571125:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787869059.571267:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939690240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787869059.571285:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec5b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869059.571296:0:22651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ec5b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869059.571356:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939690368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787869059.571391:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869059.571416:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da84fc4840 going to sleep for 11 seconds 00000100:00100000:1.0:1787869059.571511:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939690368 00000100:00100000:1.0:1787869059.571515:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939690368 00000100:00100000:1.0:1787869059.571544:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787869059.571550:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:22651:x1874715939690368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787869059.571563:0:22649:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787869059.571577:0:22649:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787869059.571580:0:22649:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1787869059.572267:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:22651:x1874715939690368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 713us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869059.572276:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787869059.576027:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939690368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787869059.576113:0:22651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787869059.576124:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec5b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869059.576135:0:22651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec5b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787869059.746441:0:23410:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787869059.939485:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869060.385808:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00010000:00010000:1.0:1787869060.963182:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869061.413459:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00010000:00010000:1.0:1787869061.994197:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787869062.279903:0:23655:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787869062.439384:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 0 seconds 00000100:00100000:1.0:1787869062.945348:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939690496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787869062.945422:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787869062.946716:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787869062.946722:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787869062.946725:0:8:0:(import.c:65:import_set_state_nolock()) ffff93da86347800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787869062.946732:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 681 00000100:00080000:2.0:1787869062.946737:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787869062.946744:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93da86347800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:2.0:1787869062.946767:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab7f5b480 x1874715939690752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787869062.946785:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787869062.946788:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787869062.946802:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787869062.946805:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787869062.946819:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787869062.946822:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787869062.946826:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787869062.946828:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787869062.946857:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939690880:0@lo:400:kworker.0 00000100:00100000:2.0:1787869062.946912:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869062.946950:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787869062.946957:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939690624:0@lo:400:kworker.0 00000100:00100000:2.0:1787869062.946985:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869062.947023:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939690624 00000100:00100000:2.0:1787869062.947031:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939690624 00000100:00100000:2.0:1787869062.947073:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787869062.947083:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:3639:x1874715939690624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787869062.947130:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:3639:x1874715939690624:12345-0@lo:400:kworker.0 Request processed in 48us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869062.947138:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787869062.947192:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939690752:0@lo:38:kworker.0 00000100:00100000:2.0:1787869062.947217:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869062.947260:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939690624:0@lo:400:kworker.0 00000100:00100000:1.0:1787869062.947408:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939690880 00000100:00100000:1.0:1787869062.947413:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939690880 00000100:00100000:1.0:1787869062.947452:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787869062.947459:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939690880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869062.947499:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939690880:12345-0@lo:400:kworker.0 Request processed in 40us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869062.947505:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787869062.947524:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939691008:0@lo:400:kworker.0 00000100:00100000:1.0:1787869062.947549:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869062.947591:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939691008 00000100:00100000:1.0:1787869062.947595:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939691008 00000100:00100000:1.0:1787869062.947616:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787869062.947623:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939691008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869062.947657:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939691008:12345-0@lo:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869062.947663:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787869062.947687:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93dab7f59e00 x1874715939691008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787869062.947699:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939691008:0@lo:400:kworker.0 00010000:00080000:1.0:1787869062.947727:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93dab7f58000 x1874715939690880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787869062.947735:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939690880:0@lo:400:kworker.0 00000100:00100000:2.0:1787869062.949234:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939690496 00000100:00100000:2.0:1787869062.949246:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939690496 00000100:00100000:2.0:1787869062.949294:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939690752 00000100:00100000:2.0:1787869062.949298:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939690752 00000100:00100000:2.0:1787869062.949312:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787869062.949321:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939690496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787869062.949356:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787869062.949436:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939690496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (4013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869062.949444:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787869062.949459:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787869062.949463:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3635:x1874715939690752:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787869062.949488:0:22659:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:2.0:1787869062.949524:0:22659:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2ec62 00000004:00100000:2.0:1787869062.949538:0:22659:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787869062.949544:0:22659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1787869062.949723:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939690496:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787869062.974439:0:22659:0:(import.c:65:import_set_state_nolock()) ffff93da88346000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787869062.974679:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1874715939690752:12345-0@lo:38:kworker.0 Request processed in 25211us (27457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869062.974705:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787869062.974825:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787869062.974836:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787869062.974845:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787869062.974851:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787869062.974854:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da86347800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787869062.974920:0:3635:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000de441c7e): req@ffff93dab7f5b0c0 x1874715939683584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869062.974943:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939690752:0@lo:38:kworker.0 00000100:00100000:0.0:1787869062.975041:0:22696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869062.975077:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd878f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787869062.975119:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939683584 00000100:00100000:1.0:1787869062.975126:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939683584 00000100:00100000:1.0:1787869062.975198:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787869062.975208:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22696:x1874715939683584:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787869062.975391:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22696:x1874715939683584:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 184us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869062.975399:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787869062.975475:0:22696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b0c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22696:1874715939683584:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1787869062.975517:0:22696:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787869062.975575:0:22696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22696:1874715939691136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787869062.975606:0:22696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869062.975638:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988ac4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787869062.975796:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939691136 00000100:00100000:2.0:1787869062.975801:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939691136 00000100:00100000:2.0:1787869062.975835:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787869062.975843:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22696:x1874715939691136:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787869062.975960:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22696:x1874715939691136:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 117us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869062.975967:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787869062.976045:0:22696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22696:1874715939691136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787869062.976120:0:22696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22696:1874715939691264:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787869062.976144:0:22696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869062.976263:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988ac4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787869062.976448:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787869062.976458:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939691392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787869062.976487:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869062.977044:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939691264 00000100:00100000:2.0:1787869062.977050:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939691264 00000100:00100000:2.0:1787869062.977076:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939691392 00000100:00100000:2.0:1787869062.977079:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939691392 00000100:00100000:2.0:1787869062.977093:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787869062.977099:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22696:x1874715939691264:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787869062.977212:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22696:x1874715939691264:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 110us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869062.977218:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787869062.977232:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787869062.977238:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874715939691392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787869062.977259:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787869062.977381:0:22696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22696:1874715939691264:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787869062.977428:0:22696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787869062.980481:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874715939691392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3232us (3981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869062.980496:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:0.0:1787869062.980953:0:22696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787869062.981031:0:22696:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:0.0:1787869062.981037:0:22696:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:2.0:1787869062.981323:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939691392:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787869063.009396:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787869063.246134:0:23707:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787869063.249205:0:23707:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787869064.041815:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787869064.313041:0:23758:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787869064.314281:0:23758:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1787869064.418333:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787869065.058187:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787869065.356708:0:23806:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7a6da100 20000000:00000080:2.0:1787869065.356727:0:23806:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93dabfb2c000 uarg=0000000000000000 20000000:01000000:2.0:1787869065.356767:0:23806:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787869065.356775:0:23806:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787869065.356780:0:23806:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787869065.357619:0:23807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1787869065.357762:0:23806:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787869065.367694:0:23806:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787869065.367726:0:23806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869065.367745:0:23806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93daace1c600/0x2f11f4d3bde2eb12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eb0b expref: 17 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869065.367753:0:23806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2ec15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec0e expref: 17 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869065.367761:0:23806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869065.367805:0:23806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2ec15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ec0e expref: 17 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869065.367820:0:23806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2ec15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec0e expref: 17 pid: 22647 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869065.367834:0:23806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23806:1874715939691520:0@lo:104: 00000100:00100000:2.0:1787869065.367894:0:23806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787869065.367956:0:23806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93daace1c600/0x2f11f4d3bde2eb12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2eb0b expref: 17 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869065.367964:0:23806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93daace1c600/0x2f11f4d3bde2eb12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2eb0b expref: 17 pid: 22647 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869065.367971:0:23806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f59a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23806:1874715939691648:0@lo:104: 00000100:00100000:2.0:1787869065.367989:0:23806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869065.368019:0:23806:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787869065.368046:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939691520 00000100:00100000:1.0:1787869065.368054:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939691520 00000100:00100000:1.0:1787869065.368090:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939691648 00000100:00100000:1.0:1787869065.368093:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939691648 00000100:00100000:1.0:1787869065.368107:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787869065.368116:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+4:23806:x1874715939691520:12345-0@lo:104: 00010000:00010000:1.0:1787869065.368128:0:22637:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ec15 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869065.368222:0:22637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787869065.368228:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+4:23806:x1874715939691520:12345-0@lo:104: Request processed in 114us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869065.368236:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787869065.368248:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869065.368255:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ec15 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869065.368263:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1c400 already unused, calling callback (ffffffffc142ec20) 00000100:00100000:1.0:1787869065.368266:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 10000000:00010000:3.0:1787869065.368267:0:22642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ec15 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869065.368272:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f59680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+3:23806:x1874715939691648:12345-0@lo:104: 00010000:00010000:3.0:1787869065.368275:0:22642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ec15 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869065.368279:0:22637:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2eb12 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787869065.368283:0:22642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ec15 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787869065.368288:0:22642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787869065.368322:0:22642:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec15 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869065.368323:0:22637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787869065.368328:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f59680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+3:23806:x1874715939691648:12345-0@lo:104: Request processed in 57us (338us total) trans 0 rc 0/0 00010000:00010000:3.0:1787869065.368329:0:22642:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787869065.368334:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787869065.368347:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec15 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869065.368349:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869065.368365:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93daace1c400/0x2f11f4d3bde2ec0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec15 expref: -99 pid: 23386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869065.368366:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3638:1874715939691776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787869065.368378:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869065.368380:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869065.368381:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787869065.368393:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869065.368487:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939691776 00000100:00100000:3.0:1787869065.368491:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939691776 00010000:00010000:3.0:1787869065.368508:0:22639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2ec15 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec0e expref: 18 pid: 22647 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869065.368542:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787869065.368548:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:3638:x1874715939691776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787869065.368558:0:22639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787869065.368562:0:22639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2ec15 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec0e expref: 18 pid: 22647 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869065.368563:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869065.368569:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2eb12 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869065.368572:0:22639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2ec15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec0e expref: 18 pid: 22647 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869065.368576:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871200 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787869065.368579:0:22643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2eb12 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869065.368585:0:22643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2eb12 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869065.368588:0:22639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:1.0:1787869065.368592:0:22643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2eb12 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869065.368597:0:22643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787869065.368612:0:22643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2eb12 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869065.368627:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:3638:x1874715939691776:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (234us total) trans 0 rc 0/0 00010000:00010000:1.0:1787869065.368627:0:22643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787869065.368634:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787869065.368638:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2eb12 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869065.368644:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dabd871200/0x2f11f4d3bde2eb0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2eb12 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869065.368655:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869065.368657:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869065.368658:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787869065.368665:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939691904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787869065.368666:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3638:1874715939691776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787869065.368690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787869065.368721:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869065.368724:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787869065.368761:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939691904 00000100:00100000:3.0:1787869065.368765:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939691904 00010000:00010000:3.0:1787869065.368785:0:22640:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93daace1c600/0x2f11f4d3bde2eb12 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2eb0b expref: 18 pid: 22647 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869065.368812:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787869065.368818:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:3639:x1874715939691904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787869065.368825:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787869065.368829:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93daace1c600/0x2f11f4d3bde2eb12 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2eb0b expref: 18 pid: 22647 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869065.368837:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93daace1c600/0x2f11f4d3bde2eb12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2eb0b expref: 18 pid: 22647 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869065.368849:0:22640:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869065.368857:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869065.368869:0:22640:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869065.368876:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869065.368883:0:22640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869065.368890:0:22640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869065.368895:0:22640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a5e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869065.368899:0:22640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869065.368913:0:22640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869065.368921:0:22640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869065.368930:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787869065.368960:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:3639:x1874715939691904:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869065.368966:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787869065.368990:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939691904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787869065.369149:0:23806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1a200/0x2f11f4d3bde2ec15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec0e expref: 17 pid: 22647 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869065.369192:0:23806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23806:1874715939691520:0@lo:104: 00010000:00010000:2.0:1787869065.369206:0:23806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93daace1c600/0x2f11f4d3bde2eb12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2eb0b expref: 16 pid: 22647 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869065.369213:0:23806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f59a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23806:1874715939691648:0@lo:104: 00010000:00010000:2.0:1787869065.369228:0:23806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869065.369237:0:23806:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869065.369244:0:23806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869065.369250:0:23806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2ec69 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869066.085961:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869067.045381:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787869057/real 1787869057] req@ffff93dab6f552c0 x1874715939686912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869067.045412:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93dab6f552c0 x1874715939686912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869067 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869067.045498:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787869057/real 1787869057] req@ffff93dabed0a1c0 x1874715939686656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869067.045515:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93dabed0a1c0 x1874715939686656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869067 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869067.045526:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787869052/real 1787869052] req@ffff93dab6f55e00 x1874715939684608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869067.045554:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93dab6f55e00 x1874715939684608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869067 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869067.045564:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787869052/real 1787869052] req@ffff93dab6f54000 x1874715939684736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869067.045575:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93dab6f54000 x1874715939684736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869067 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787869067.045593:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da88341000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787869067.045767:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787869067.045772:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939686912:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787869067.045779:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab5bc4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787869067.050334:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869067.050341:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787869067.050344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869067.050347:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787869067.050373:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869067.050376:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787869067.050380:0:36:0:(import.c:65:import_set_state_nolock()) ffff93dab5bc4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787869067.050389:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 681 00000100:00080000:1.0:1787869067.050395:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787869067.050402:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93dab5bc4000 using connection 192.168.204.127@tcp/0@lo 00000100:00080000:2.0:1787869067.050826:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787869067.050836:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939686656:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787869067.050847:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d981c0d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787869067.050854:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787869067.050858:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939684608:0@lo:8:kworker.0 00000100:00080000:2.0:1787869067.050863:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d98895e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787869067.050867:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787869067.050871:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939684736:0@lo:8:kworker.0 00000100:00100000:1.0:1787869067.051057:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da93093480 x1874715939692544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787869067.051099:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869067.051103:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787869067.051106:0:36:0:(import.c:65:import_set_state_nolock()) ffff93da88341000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787869067.051110:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 681 00000100:00080000:1.0:1787869067.051115:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787869067.051121:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93da88341000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787869067.051140:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da93093840 x1874715939692672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787869067.051198:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869067.051201:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787869067.051203:0:36:0:(import.c:65:import_set_state_nolock()) ffff93d981c0d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787869067.051206:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 676 00000100:00080000:1.0:1787869067.051209:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787869067.051212:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d981c0d800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787869067.051222:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da930921c0 x1874715939692928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787869067.051230:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869067.051233:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787869067.051235:0:36:0:(import.c:65:import_set_state_nolock()) ffff93d98895e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787869067.051238:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 676 00000100:00080000:1.0:1787869067.051240:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787869067.051243:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d98895e800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787869067.051252:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da93090780 x1874715939693056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787869067.051290:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939692160:0@lo:400:kworker.0 00000100:00100000:1.0:1787869067.051359:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869067.051402:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787869067.051410:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3637:1874715939692032:0@lo:400:kworker.0 00000100:00100000:2.0:1787869067.051546:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939692544:0@lo:8:kworker.0 00000400:00000100:2.0:1787869067.051572:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939692544 offset 0 length 520: 4 00000100:00100000:2.0:1787869067.051616:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93093840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939692672:0@lo:8:kworker.0 00000400:00000100:2.0:1787869067.051647:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939692672 offset 0 length 520: 4 00000100:00100000:2.0:1787869067.051657:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da930921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939692928:0@lo:8:kworker.0 00000400:00000100:2.0:1787869067.051669:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939692928 offset 0 length 520: 4 00000100:00100000:2.0:1787869067.051677:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939693056:0@lo:8:kworker.0 00000400:00000100:2.0:1787869067.051688:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874715939693056 offset 0 length 520: 4 00000100:00100000:0.0:1787869067.052115:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939692160 00000100:00100000:0.0:1787869067.052125:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939692160 00000100:00100000:0.0:1787869067.052202:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787869067.052212:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da930903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939692160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869067.052274:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da930903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874715939692160:12345-0@lo:400:kworker.0 Request processed in 63us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869067.052281:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787869067.052378:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869067.052403:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939692800:0@lo:400:kworker.0 00000100:00100000:0.0:1787869067.052534:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939692032 00000100:00100000:0.0:1787869067.052539:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939692032 00000100:00100000:0.0:1787869067.052592:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787869067.052606:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+16:3637:x1874715939692032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869067.052640:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+16:3637:x1874715939692032:12345-0@lo:400:kworker.0 Request processed in 42us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869067.052646:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787869067.052792:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869067.052834:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939692160:0@lo:400:kworker.0 00000100:00100000:1.0:1787869067.052853:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3637:1874715939692032:0@lo:400:kworker.0 00000100:00100000:1.0:1787869067.052872:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939692288:0@lo:400:kworker.0 00000100:00100000:1.0:1787869067.052898:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869067.052919:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787869067.052926:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939692416:0@lo:400:kworker.0 00000100:00100000:1.0:1787869067.052946:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869067.052972:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939692800 00000100:00100000:1.0:1787869067.052975:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939692800 00000100:00100000:1.0:1787869067.052999:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939692288 00000100:00100000:1.0:1787869067.053001:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939692288 00000100:00100000:1.0:1787869067.053012:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787869067.053018:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93090f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939692800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869067.053049:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93090f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939692800:12345-0@lo:400:kworker.0 Request processed in 32us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869067.053055:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787869067.053065:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787869067.053081:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93091a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939692288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869067.053123:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93091a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939692288:12345-0@lo:400:kworker.0 Request processed in 42us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869067.053129:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787869067.053174:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93dabed08f00 x1874715939692288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787869067.053185:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939692288:0@lo:400:kworker.0 00000100:00100000:1.0:1787869067.053200:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939692416 00000100:00100000:1.0:1787869067.053203:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939692416 00000100:00100000:1.0:1787869067.053218:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787869067.053223:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93092d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939692416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869067.053254:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93092d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939692416:12345-0@lo:400:kworker.0 Request processed in 30us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869067.053260:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787869067.053279:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939692416:0@lo:400:kworker.0 00010000:00080000:1.0:1787869067.053297:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93da93090b40 x1874715939692800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787869067.053306:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939692800:0@lo:400:kworker.0 10000000:01000000:3.0:1787869067.108410:0:22651:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787869067.108419:0:22651:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93da88303000 from 13 10000000:01000000:3.0:1787869067.108425:0:22651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787869067.108474:0:22651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869067.108496:0:22651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869067.108507:0:22651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869067.108535:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939693184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787869067.108626:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869067.108661:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da91624480 going to sleep for 11 seconds 00010000:00010000:1.0:1787869067.109082:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869067.109145:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939693184 00000100:00100000:2.0:1787869067.109177:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939693184 00000100:00100000:2.0:1787869067.109231:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787869067.109241:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+16:22651:x1874715939693184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787869067.109257:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869067.109271:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ec70 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869067.109293:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec70 expref: 17 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869067.109303:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec70 expref: 17 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869067.109313:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a5a00, rc 0) 00000100:00100000:2.0:1787869067.109363:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:22651:x1874715939693184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869067.109369:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787869067.111525:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939693184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787869067.111566:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec77 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869067.111588:0:22651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ec77 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869067.113954:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f59a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939693312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787869067.114033:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869067.114077:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787869067.114181:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939693312 00000100:00100000:1.0:1787869067.114188:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939693312 00000100:00100000:1.0:1787869067.114240:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787869067.114250:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:22651:x1874715939693312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787869067.114386:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:22651:x1874715939693312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869067.114403:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787869067.114464:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f59a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939693312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787869067.114511:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939693440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787869067.114554:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869067.114586:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988ac4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787869067.114609:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939693440 00000100:00100000:1.0:1787869067.114613:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939693440 00000100:00100000:1.0:1787869067.114638:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787869067.114644:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:22651:x1874715939693440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787869067.114721:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:22651:x1874715939693440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869067.114729:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787869067.114771:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939693440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787869067.115472:0:23876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787869067.115546:0:22651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787869067.115569:0:22651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787869067.115580:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec77 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869067.115591:0:22651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec77 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869067.115602:0:22651:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787869067.115605:0:22651:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dab523f000 from 13 10000000:01000000:1.0:1787869067.115608:0:22651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787869067.115634:0:22651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869067.115652:0:22651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869067.115662:0:22651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869067.115680:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939693568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787869067.115720:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869067.115740:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988ac4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787869067.115756:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939693568 00000100:00100000:1.0:1787869067.115761:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939693568 00000100:00100000:1.0:1787869067.115793:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787869067.115801:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+17:22651:x1874715939693568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787869067.115812:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787869067.115825:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2ec85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ec7e expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869067.115850:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2ec85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec7e expref: 18 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869067.115862:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2ec85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec7e expref: 18 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869067.115871:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1a600, rc 0) 00000100:00100000:1.0:1787869067.115904:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:22651:x1874715939693568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869067.115912:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787869067.115959:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939693568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787869067.115972:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec85 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869067.115981:0:22651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ec85 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869067.116025:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939693696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787869067.116050:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869067.116063:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988ac4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787869067.116074:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939693696 00000100:00100000:1.0:1787869067.116077:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939693696 00000100:00100000:1.0:1787869067.116097:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787869067.116103:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:22651:x1874715939693696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787869067.116210:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:22651:x1874715939693696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869067.116216:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787869067.116243:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939693696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787869067.116265:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939693824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787869067.116298:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869067.116310:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988ac4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787869067.116321:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939693824 00000100:00100000:1.0:1787869067.116324:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939693824 00000100:00100000:1.0:1787869067.116344:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787869067.116349:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:22651:x1874715939693824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787869067.116412:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:22651:x1874715939693824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869067.116425:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787869067.116460:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939693824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787869067.121994:0:23877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787869067.131950:0:22651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787869067.131990:0:22651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787869067.132003:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec85 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869067.132016:0:22651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ec85 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869068.065331:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787869068.065356:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939693952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787869068.065500:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939694080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787869068.065552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869068.065641:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939694080 00000100:00100000:0.0:1787869068.065648:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939694080 00000100:00100000:0.0:1787869068.065707:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787869068.065725:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93090b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939694080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787869068.065758:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787869068.065809:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93090b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939694080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869068.065816:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787869068.066105:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869068.066196:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939693952 00000100:00100000:0.0:1787869068.066201:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939693952 00000100:00100000:0.0:1787869068.066223:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787869068.066230:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874715939693952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787869068.066248:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787869068.066287:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874715939693952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869068.066295:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787869068.066349:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939694080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787869068.066379:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939693952:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787869068.133593:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787869069.093102:0:23387:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787869069.162112:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787869069.987708:0:23410:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787869070.179248:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869071.201334:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787869072.106391:0:24155:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787869072.106396:0:24155:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787869072.106398:0:24155:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787869072.106660:0:24155:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93dab7efc800 00000020:01000004:0.0:1787869072.106677:0:24155:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787869072.106691:0:24155:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787869072.106704:0:24155:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93dabda5b490) 00000020:00000080:0.0:1787869072.106722:0:24155:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00000100:00080000:0.0:1787869072.162117:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787869072.162125:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787869072.162128:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787869072.162132:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787869072.162138:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939694208:0@lo:400:kworker.0 00000100:00080000:0.0:1787869072.162153:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787869072.162191:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787869072.162194:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787869072.162198:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787869072.162233:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939694592:0@lo:400:kworker.0 00000100:00100000:2.0:1787869072.162241:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869072.162284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869072.162306:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939694720:0@lo:400:kworker.0 00000100:00100000:0.0:1787869072.162322:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939694336:0@lo:400:kworker.0 00000100:00100000:2.0:1787869072.162348:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869072.162356:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869072.162395:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787869072.162404:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939694464:0@lo:400:kworker.0 00000100:00100000:3.0:1787869072.162410:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939694208 00000100:00100000:2.0:1787869072.162411:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939694720 00000100:00100000:3.0:1787869072.162420:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939694208 00000100:00100000:2.0:1787869072.162420:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939694720 00000100:00100000:0.0:1787869072.162431:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869072.162469:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939694592 00000100:00100000:0.0:1787869072.162474:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939694592 00000100:00100000:2.0:1787869072.162477:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939694464 00000100:00100000:2.0:1787869072.162482:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939694464 00000100:00100000:3.0:1787869072.162485:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787869072.162510:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939694336 00000100:00100000:0.0:1787869072.162514:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939694336 00000100:00100000:0.0:1787869072.162531:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787869072.162538:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939694592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787869072.162564:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:3639:x1874715939694208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869072.162592:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939694592:12345-0@lo:400:kworker.0 Request processed in 53us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869072.162600:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787869072.162619:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:3639:x1874715939694208:12345-0@lo:400:kworker.0 Request processed in 123us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869072.162620:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787869072.162631:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939694336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787869072.162632:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787869072.162672:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939694336:12345-0@lo:400:kworker.0 Request processed in 43us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869072.162678:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787869072.162806:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939694208:0@lo:400:kworker.0 00000100:00100000:0.0:1787869072.163561:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787869072.163668:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787869072.163681:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939694464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787869072.163733:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939694464:12345-0@lo:400:kworker.0 Request processed in 56us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869072.163740:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787869072.163787:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93dab6f55e00 x1874715939694464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869072.163808:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939694464:0@lo:400:kworker.0 00000100:00100000:2.0:1787869072.163822:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939694336:0@lo:400:kworker.0 00000100:00100000:2.0:1787869072.163859:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939694592:0@lo:400:kworker.0 00000100:00100000:0.0:1787869072.171507:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939694720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869072.171646:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939694720:12345-0@lo:400:kworker.0 Request processed in 169us (9297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869072.171657:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787869072.173958:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93dab6f570c0 x1874715939694720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869072.173976:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939694720:0@lo:400:kworker.0 00100000:10000000:2.0:1787869072.189259:0:24155:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787869072.190413:0:24155:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787869072.190670:0:24155:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787869072.191019:0:24155:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787869072.191614:0:24155:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787869072.191829:0:24155:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787869072.192237:0:24155:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1787869072.196689:0:24155:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787869072.196890:0:24155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787869072.196905:0:24155:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787869072.196917:0:24155:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2f11f4d3bde2ec93 00000020:01000004:2.0:1787869072.196925:0:24155:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787869072.204377:0:24155:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787869072.204395:0:24155:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787869072.204406:0:24155:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787869072.204416:0:24155:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787869072.204432:0:24155:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93d9863d4ed8) 00000020:00000080:3.0:1787869072.204452:0:24155:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1787869072.207320:0:24155:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787869072.207698:0:24155:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787869072.207706:0:24155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787869072.213878:0:24155:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787869072.213892:0:24155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787869072.214592:0:24155:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787869072.214601:0:24155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787869072.219731:0:24155:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787869072.219928:0:24155:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787869072.219941:0:24155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00010000:00010000:1.0:1787869072.226667:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869072.226728:0:24155:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787869072.226739:0:24155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787869072.260438:0:24155:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787869072.260671:0:24155:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787869072.260679:0:24155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787869072.264550:0:24155:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787869072.264567:0:24155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787869072.266258:0:24155:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787869072.266271:0:24155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787869072.269542:0:24155:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787869072.269733:0:24155:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787869072.269738:0:24155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787869072.270921:0:24155:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787869072.270930:0:24155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787869072.316452:0:24155:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787869072.316734:0:24155:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787869072.316741:0:24155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787869072.318119:0:24155:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787869072.318130:0:24155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787869072.319305:0:24155:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787869072.319339:0:24155:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787869072.319346:0:24155:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787869072.338333:0:24155:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787869072.338373:0:24155:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.127@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787869072.338432:0:24155:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787869072.338434:0:24155:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787869072.338435:0:24155:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787869072.338436:0:24155:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787869072.338438:0:24155:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787869072.338439:0:24155:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787869072.338441:0:24155:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787869072.338443:0:24155:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787869072.338444:0:24155:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787869072.338448:0:24155:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787869072.338450:0:24155:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787869072.338451:0:24155:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787869072.338452:0:24155:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787869072.338453:0:24155:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787869072.338454:0:24155:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787869072.338455:0:24155:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787869072.338456:0:24155:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787869072.338457:0:24155:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787869072.338458:0:24155:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787869072.338485:0:24155:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787869072.338506:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939694848:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787869072.338678:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869072.338815:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da914a5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787869072.338915:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939694848 00000100:00100000:2.0:1787869072.338922:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939694848 00000100:00100000:2.0:1787869072.339029:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787869072.339050:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:24155:x1874715939694848:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787869072.339103:0:22648:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787869072.339107:0:22648:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787869072.339111:0:22648:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787869072.339670:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:24155:x1874715939694848:12345-0@lo:253:mount.lustre.0 Request processed in 631us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869072.339679:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787869072.339753:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939694848:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787869072.339764:0:24155:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787869072.339766:0:24155:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787869072.339767:0:24155:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787869072.339768:0:24155:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787869072.339769:0:24155:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787869072.339770:0:24155:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787869072.339771:0:24155:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787869072.339772:0:24155:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787869072.339773:0:24155:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787869072.339774:0:24155:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787869072.339797:0:24155:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93dab7efc800 from lustre-OST0000 10000000:01000000:1.0:1787869072.339824:0:24155:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787869072.339827:0:24155:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787869072.339835:0:24155:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93dabd2f9a48 local copy 00010000:00010000:1.0:1787869072.339845:0:24155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea55 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869072.339923:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939694976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787869072.339952:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869072.340346:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da914a5300 going to sleep for 11 seconds 00000100:00100000:2.0:1787869072.340444:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939694976 00000100:00100000:2.0:1787869072.340450:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939694976 00000100:00100000:2.0:1787869072.340599:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787869072.340676:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:24155:x1874715939694976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787869072.340763:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:24155:x1874715939694976:12345-0@lo:501:mount.lustre.0 Request processed in 156us (809us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787869072.340770:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787869072.340791:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939694976:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787869072.340810:0:24155:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787869072.340832:0:24155:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787869072.340839:0:24155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea55 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.340849:0:24155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea55 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869072.340887:0:24155:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93dab7efc800 10000000:01000000:1.0:1787869072.340892:0:24155:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787869072.340897:0:24155:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787869072.340900:0:24155:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787869072.340904:0:24155:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787869072.340907:0:24155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787869072.340932:0:24155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2eca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.340940:0:24155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2eca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.340949:0:24155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2eca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869072.340964:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939695104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787869072.340992:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869072.341016:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da914a5300 going to sleep for 11 seconds 00000100:00100000:3.0:1787869072.341217:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939695104 00000100:00100000:3.0:1787869072.341222:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939695104 00000100:00100000:3.0:1787869072.341303:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787869072.341312:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+18:24155:x1874715939695104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787869072.341321:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869072.341333:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870400/0x2f11f4d3bde2eca8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2eca1 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869072.341356:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870400/0x2f11f4d3bde2eca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eca1 expref: 19 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869072.341367:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870400/0x2f11f4d3bde2eca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eca1 expref: 19 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869072.341376:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870400, rc 0) 00000100:00100000:3.0:1787869072.341740:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+19:24155:x1874715939695104:12345-0@lo:101:mount.lustre.0 Request processed in 429us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869072.341759:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787869072.341824:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939695104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787869072.341838:0:24155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2eca1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eca8 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.341847:0:24155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2eca1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2eca8 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787869072.342987:0:24155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1787869072.343848:0:24155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787869072.358287:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787869072.358357:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787869072.358376:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787869072.358405:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787869072.358419:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787869072.358431:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787869072.358444:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787869072.358457:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787869072.358468:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1787869072.358829:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1787869072.358849:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1787869072.358863:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1787869072.358890:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1787869072.358895:0:24155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1787869072.359009:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939695232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787869072.359075:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869072.359339:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e20b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787869072.359395:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939695232 00000100:00100000:2.0:1787869072.359403:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939695232 00000100:00100000:2.0:1787869072.359507:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787869072.359518:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+19:24155:x1874715939695232:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787869072.359879:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+19:24155:x1874715939695232:12345-0@lo:501:mount.lustre.0 Request processed in 361us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869072.359886:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787869072.359970:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939695232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787869072.360005:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939695360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787869072.360048:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869072.360283:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e20b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787869072.360394:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939695360 00000100:00100000:0.0:1787869072.360400:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939695360 00000100:00100000:0.0:1787869072.360425:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787869072.360432:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+19:24155:x1874715939695360:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787869072.361357:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+19:24155:x1874715939695360:12345-0@lo:503:mount.lustre.0 Request processed in 922us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869072.361366:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787869072.361471:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939695360:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787869072.361894:0:24155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787869072.361967:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939695488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869072.362016:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869072.362054:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e20b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787869072.362253:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939695488 00000100:00100000:0.0:1787869072.362259:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939695488 00000100:00100000:0.0:1787869072.362287:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787869072.362295:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+19:24155:x1874715939695488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787869072.362939:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+19:24155:x1874715939695488:12345-0@lo:502:mount.lustre.0 Request processed in 643us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869072.362948:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787869072.363035:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939695488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787869072.363272:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787869072.363302:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787869072.363314:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787869072.363324:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787869072.363335:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787869072.363346:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787869072.363356:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787869072.363366:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787869072.363388:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1787869072.363405:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1787869072.363417:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1787869072.363430:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1787869072.363461:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939695616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869072.363516:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869072.363539:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e20b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787869072.363701:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939695616 00000100:00100000:0.0:1787869072.363705:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939695616 00000100:00100000:0.0:1787869072.363730:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787869072.363736:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+19:24155:x1874715939695616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787869072.363817:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+19:24155:x1874715939695616:12345-0@lo:502:mount.lustre.0 Request processed in 80us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869072.363824:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787869072.364044:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939695616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787869072.364151:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1787869072.364185:0:24155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787869072.365652:0:24172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787869072.365667:0:24172:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787869072.365676:0:24172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869072.365678:0:24172:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787869072.365685:0:24172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787869072.365699:0:24172:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93dabda59a48) 00000020:00000080:0.0:1787869072.365722:0:24172:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787869072.365729:0:24172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787869072.365791:0:24172:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93dab7efc800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787869072.365800:0:24172:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787869072.365807:0:24172:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2f11f4d3bde2ecb6 00010000:00010000:0.0:1787869072.370781:0:24172:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1787869072.371395:0:24172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:0.0:1787869072.373371:0:24172:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1787869072.375648:0:24172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787869072.375669:0:24172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787869072.375676:0:24172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869072.375679:0:24172:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787869072.375682:0:24172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787869072.375685:0:24172:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1787869072.375687:0:24172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787869072.375688:0:24172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787869072.375690:0:24172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787869072.375693:0:24172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869072.375694:0:24172:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787869072.375697:0:24172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787869072.375700:0:24172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869072.375701:0:24172:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787869072.375704:0:24172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787869072.375705:0:24172:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787869072.375707:0:24172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787869072.375709:0:24172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869072.375711:0:24172:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787869072.375713:0:24172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787869072.375715:0:24172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869072.375723:0:24172:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787869072.375727:0:24172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787869072.375754:0:24172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787869072.375756:0:24172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787869072.375758:0:24172:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787869072.375760:0:24172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1787869072.379726:0:24155:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787869072.379777:0:24155:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787869072.380082:0:24155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2eca1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eca8 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.380105:0:24155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1bc00/0x2f11f4d3bde2eca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2eca8 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787869072.383392:0:24155:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dab7efc800 from 1 10000000:01000000:0.0:1787869072.383401:0:24155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787869072.383448:0:24155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869072.383460:0:24155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869072.383472:0:24155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869072.383547:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939695744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787869072.383856:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869072.383905:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d981c2b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787869072.384250:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939695744 00000100:00100000:0.0:1787869072.384259:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939695744 00000100:00100000:0.0:1787869072.384319:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787869072.384329:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+19:24155:x1874715939695744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787869072.384344:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869072.384361:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93daace1d800/0x2f11f4d3bde2ecc4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ecbd expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869072.384398:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93daace1d800/0x2f11f4d3bde2ecc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ecbd expref: 20 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869072.384424:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93daace1d800/0x2f11f4d3bde2ecc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ecbd expref: 20 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869072.384434:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1d800, rc 0) 00000100:00100000:0.0:1787869072.384686:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:24155:x1874715939695744:12345-0@lo:101:mount.lustre.0 Request processed in 155us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869072.384695:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787869072.384880:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939695744:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787869072.384898:0:24155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ecc4 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869072.384907:0:24155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ecc4 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787869072.392430:0:24155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1787869072.393208:0:24155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787869072.393428:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1787869072.393705:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1787869072.393721:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1787869072.393735:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1787869072.393747:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1787869072.393758:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1787869072.393768:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1787869072.393779:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1787869072.393791:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1787869072.393803:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1787869072.393814:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1787869072.393832:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1787869072.393844:0:24155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1787869072.393918:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939695872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787869072.393984:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869072.394204:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d981c2b600 going to sleep for 11 seconds 00000100:00100000:3.0:1787869072.395471:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939695872 00000100:00100000:3.0:1787869072.395483:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939695872 00000100:00100000:3.0:1787869072.395554:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787869072.395565:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:24155:x1874715939695872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787869072.395711:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:24155:x1874715939695872:12345-0@lo:501:mount.lustre.0 Request processed in 147us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869072.395720:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787869072.395888:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939695872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787869072.395932:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787869072.395983:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869072.396019:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d981c2b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787869072.396205:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939696000 00000100:00100000:2.0:1787869072.396211:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939696000 00000100:00100000:2.0:1787869072.396237:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787869072.396244:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:24155:x1874715939696000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787869072.396337:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:24155:x1874715939696000:12345-0@lo:503:mount.lustre.0 Request processed in 93us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869072.396344:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787869072.396365:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696000:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787869072.396791:0:24155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787869072.396869:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787869072.396906:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869072.396940:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d981c2b180 going to sleep for 11 seconds 00000100:00100000:3.0:1787869072.397504:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939696128 00000100:00100000:3.0:1787869072.397511:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939696128 00000100:00100000:3.0:1787869072.397561:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787869072.397569:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:24155:x1874715939696128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787869072.397691:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:24155:x1874715939696128:12345-0@lo:502:mount.lustre.0 Request processed in 123us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869072.397699:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787869072.397906:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787869072.398844:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787869072.398878:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1787869072.398892:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1787869072.398905:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1787869072.398917:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1787869072.398927:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787869072.398951:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1787869072.398965:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1787869072.398976:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1787869072.398988:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1787869072.399000:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1787869072.399030:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787869072.399100:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869072.399132:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99ebb900 going to sleep for 11 seconds 00000100:00100000:0.0:1787869072.399279:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939696256 00000100:00100000:0.0:1787869072.399286:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939696256 00000100:00100000:0.0:1787869072.399324:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787869072.399331:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:24155:x1874715939696256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787869072.399446:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:24155:x1874715939696256:12345-0@lo:502:mount.lustre.0 Request processed in 115us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869072.399453:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787869072.400352:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787869072.400443:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1787869072.400454:0:24155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787869072.402685:0:24176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869072.402698:0:24176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869072.402700:0:24176:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787869072.402706:0:24176:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93dab7efc800 00000020:00000080:3.0:1787869072.402708:0:24176:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787869072.402718:0:24176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869072.402721:0:24176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869072.402723:0:24176:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787869072.402725:0:24176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869072.402727:0:24176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869072.402729:0:24176:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787869072.402732:0:24176:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93dab7efc800 00000020:00000080:3.0:1787869072.402734:0:24176:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787869072.402834:0:24176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869072.402838:0:24176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869072.402840:0:24176:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787869072.402843:0:24176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869072.402845:0:24176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869072.402846:0:24176:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787869072.402849:0:24176:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93dab7efc800 00000020:00000080:3.0:1787869072.402852:0:24176:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787869072.409949:0:24176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869072.409963:0:24176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869072.409965:0:24176:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787869072.409969:0:24176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869072.409974:0:24176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869072.409975:0:24176:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787869072.409986:0:24176:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93dab7efc800 00000020:00000080:3.0:1787869072.409988:0:24176:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787869072.410054:0:24176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869072.410057:0:24176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869072.410059:0:24176:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787869072.410063:0:24176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1787869072.414423:0:24155:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787869072.414464:0:24155:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787869072.414492:0:24155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ecc4 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.414518:0:24155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ecc4 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869072.414578:0:24155:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787869072.414581:0:24155:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93dab7efc800 10000000:01000000:1.0:1787869072.414584:0:24155:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93dab7efc800 10000000:01000000:1.0:1787869072.414588:0:24155:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787869072.414594:0:24155:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93dab7efc800 from 1 10000000:01000000:1.0:1787869072.414597:0:24155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787869072.414633:0:24155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2eccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.414641:0:24155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2eccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.414652:0:24155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2eccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869072.416799:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787869072.416865:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869072.416901:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e20a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787869072.418820:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939696384 00000100:00100000:0.0:1787869072.418834:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939696384 00000100:00100000:0.0:1787869072.418898:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787869072.418909:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:24155:x1874715939696384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787869072.418927:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869072.418951:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93daace1c200/0x2f11f4d3bde2ecd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2eccb expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869072.418984:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93daace1c200/0x2f11f4d3bde2ecd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eccb expref: 21 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869072.418996:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93daace1c200/0x2f11f4d3bde2ecd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2eccb expref: 21 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869072.419006:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1c200, rc 0) 00000100:00100000:0.0:1787869072.419187:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24155:x1874715939696384:12345-0@lo:101:mount.lustre.0 Request processed in 279us (2322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869072.419194:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787869072.419325:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787869072.419345:0:24155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2eccb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ecd2 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.419355:0:24155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2eccb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ecd2 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787869072.426297:0:24155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787869072.426613:0:24155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787869072.427465:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787869072.427506:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787869072.427519:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787869072.427530:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787869072.427542:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787869072.427552:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787869072.427563:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787869072.427577:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787869072.427589:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787869072.427600:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787869072.427611:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787869072.427642:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787869072.427656:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787869072.427667:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787869072.427678:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787869072.427690:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787869072.427720:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787869072.427733:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787869072.427746:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787869072.427758:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787869072.427770:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787869072.427782:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787869072.427794:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787869072.427807:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787869072.427819:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787869072.427833:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787869072.427845:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787869072.427872:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787869072.427888:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787869072.427914:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787869072.427925:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787869072.427937:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787869072.427949:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787869072.427961:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787869072.427974:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787869072.427987:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787869072.427998:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787869072.428017:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787869072.428031:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787869072.428044:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787869072.428057:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787869072.428068:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787869072.428081:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787869072.428111:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787869072.428125:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787869072.428136:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787869072.428148:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787869072.428186:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787869072.428303:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787869072.428322:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787869072.428338:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787869072.428344:0:24155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787869072.428452:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787869072.428517:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869072.428569:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e20840 going to sleep for 11 seconds 00000100:00100000:3.0:1787869072.428622:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939696512 00000100:00100000:3.0:1787869072.428629:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939696512 00000100:00100000:3.0:1787869072.428680:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787869072.428689:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24155:x1874715939696512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787869072.428811:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24155:x1874715939696512:12345-0@lo:501:mount.lustre.0 Request processed in 123us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869072.428819:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787869072.428938:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787869072.428971:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787869072.429009:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869072.429034:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e20840 going to sleep for 11 seconds 00000100:00100000:3.0:1787869072.429286:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939696640 00000100:00100000:3.0:1787869072.429291:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939696640 00000100:00100000:3.0:1787869072.429316:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787869072.429322:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24155:x1874715939696640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787869072.429408:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24155:x1874715939696640:12345-0@lo:503:mount.lustre.0 Request processed in 85us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869072.429414:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787869072.429652:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696640:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787869072.430039:0:24155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787869072.430103:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869072.430146:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869072.430191:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939696768 00000100:00100000:1.0:1787869072.430195:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939696768 00000100:00100000:1.0:1787869072.430224:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787869072.430231:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24155:x1874715939696768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869072.430312:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24155:x1874715939696768:12345-0@lo:502:mount.lustre.0 Request processed in 81us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869072.430319:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787869072.430358:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e20a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787869072.430372:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787869072.430559:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787869072.430583:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1787869072.430598:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1787869072.430611:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1787869072.430626:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1787869072.430654:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1787869072.430671:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1787869072.430683:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1787869072.430696:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787869072.430708:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1787869072.430721:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1787869072.430733:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1787869072.430744:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1787869072.430757:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1787869072.430770:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1787869072.430792:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1787869072.430806:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1787869072.430819:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1787869072.430831:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787869072.430843:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787869072.430855:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1787869072.430881:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1787869072.430896:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1787869072.430910:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1787869072.430923:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1787869072.430935:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1787869072.430952:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1787869072.430963:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1787869072.430975:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1787869072.430987:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1787869072.430998:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1787869072.431009:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1787869072.431020:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1787869072.431031:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1787869072.431043:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1787869072.431055:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1787869072.431067:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1787869072.431096:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1787869072.431111:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1787869072.431125:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1787869072.431139:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1787869072.431152:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1787869072.431188:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1787869072.431202:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1787869072.431215:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1787869072.431228:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1787869072.431242:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1787869072.431253:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1787869072.431297:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869072.431345:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869072.431393:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e20a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787869072.431562:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939696896 00000100:00100000:3.0:1787869072.431569:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939696896 00000100:00100000:3.0:1787869072.431605:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787869072.431613:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24155:x1874715939696896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787869072.431716:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24155:x1874715939696896:12345-0@lo:502:mount.lustre.0 Request processed in 104us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869072.431723:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787869072.431815:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939696896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787869072.431954:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1787869072.431976:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1787869072.431996:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939697024:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869072.432029:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869072.432053:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939697024 00000100:00100000:1.0:1787869072.432056:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939697024 00000100:00100000:1.0:1787869072.432089:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787869072.432096:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24155:x1874715939697024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869072.432194:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24155:x1874715939697024:12345-0@lo:502:mount.lustre.0 Request processed in 98us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869072.432200:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787869072.432229:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e20a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787869072.432241:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939697024:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787869072.432279:0:24155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1787869072.432286:0:24155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787869072.435368:0:24181:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787869072.435404:0:24181:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93d9863d3490) 00000020:00000080:3.0:1787869072.435428:0:24181:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1787869072.435593:0:24181:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93dab7efc800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787869072.435598:0:24181:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93dab7efc800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787869072.435600:0:24181:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93dab7efc800 3 00010000:00080000:3.0:1787869072.435630:0:24181:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93daa05db800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1787869072.441740:0:24181:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1787869072.441951:0:24181:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787869072.441998:0:24181:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787869072.442025:0:24181:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2f11f4d3bde2ece0 00000100:00080000:3.0:1787869072.442037:0:24181:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787869072.442043:0:24181:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93daa05db800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787869072.442076:0:24181:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9888c3c00 x1874715939697152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787869072.442097:0:24181:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787869072.442270:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869072.442276:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787869072.442278:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869072.442281:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787869072.442285:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869072.442294:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787869072.442297:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869072.442300:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:3.0:1787869072.442724:0:24181:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787869072.442746:0:24181:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93d981b21a48) 00000020:00000080:3.0:1787869072.442762:0:24181:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1787869072.445410:0:24181:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93dab7efc800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787869072.445420:0:24181:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93dab7efc800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787869072.445424:0:24181:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93dab7efc800 3 00010000:00080000:3.0:1787869072.445482:0:24181:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d9882a0800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.127@tcp at head 00010000:00010000:3.0:1787869072.447090:0:24181:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1787869072.447302:0:24181:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1787869072.447345:0:24181:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787869072.447357:0:24181:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2f11f4d3bde2ecee 00000100:00080000:3.0:1787869072.447368:0:24181:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787869072.447374:0:24181:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93d9882a0800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:3.0:1787869072.447422:0:24181:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9888c2d00 x1874715939697280/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787869072.447445:0:24181:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787869072.455315:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1874715939697152:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787869072.455405:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869072.455450:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1874715939697280:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787869072.455477:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869072.455515:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939697152 00000100:00100000:2.0:1787869072.455975:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939697152 00000100:00100000:2.0:1787869072.456019:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939697280 00000100:00100000:2.0:1787869072.456022:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939697280 00000100:00100000:2.0:1787869072.456035:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787869072.456043:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1874715939697152:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787869072.456259:0:22655:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:2.0:1787869072.456303:0:22655:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2f11f4d3bde2ecf5 00000004:00100000:2.0:1787869072.456319:0:22655:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787869072.456354:0:22655:0:(import.c:65:import_set_state_nolock()) ffff93dab5bf6800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787869072.456417:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869072.456422:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787869072.456425:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1787869072.456427:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874715939697152:12345-0@lo:38:llog_process_th.0 Request processed in 385us (1023us total) trans 0 rc 0/0 00000100:00080000:1.0:1787869072.456428:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787869072.456432:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869072.456434:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787869072.456435:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787869072.456437:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869072.456439:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787869072.456450:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787869072.456454:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1874715939697280:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787869072.456471:0:22655:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:2.0:1787869072.456504:0:22655:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2f11f4d3bde2ecfc 00000004:00100000:2.0:1787869072.456511:0:22655:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787869072.456992:0:22655:0:(import.c:65:import_set_state_nolock()) ffff93dabe213000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787869072.457029:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874715939697280:12345-0@lo:38:llog_process_th.0 Request processed in 573us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869072.457045:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787869072.457686:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9888c3c00 x1874715939697152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787869082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869072.457698:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787869072.457706:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1787869072.457714:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787869072.457719:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787869072.457722:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93daa05db800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787869072.457728:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3635:1874715939697152:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787869072.457744:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9888c2d00 x1874715939697280/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787869082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869072.457752:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787869072.457755:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1787869072.457759:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787869072.457762:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787869072.457764:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d9882a0800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787869072.457767:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3635:1874715939697280:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787869072.466805:0:24181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1787869072.466889:0:24155:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787869072.466921:0:24155:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787869072.466937:0:24155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2eccb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ecd2 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869072.466959:0:24155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b800/0x2f11f4d3bde2eccb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ecd2 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787869072.467006:0:24155:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787869072.467009:0:24155:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787869072.467010:0:24155:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787869072.467011:0:24155:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787869072.467012:0:24155:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787869072.467014:0:24155:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787869072.467015:0:24155:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787869072.467017:0:24155:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787869072.467018:0:24155:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787869072.467022:0:24155:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787869072.467024:0:24155:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787869072.467025:0:24155:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787869072.467026:0:24155:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787869072.467027:0:24155:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787869072.467028:0:24155:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787869072.467030:0:24155:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787869072.467031:0:24155:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787869072.467031:0:24155:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787869072.467032:0:24155:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787869072.467078:0:24155:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787869072.467100:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939697408:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787869072.467193:0:24155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869072.467230:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da938b1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787869072.468100:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939697408 00000100:00100000:3.0:1787869072.468110:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939697408 00000100:00100000:3.0:1787869072.468182:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787869072.468193:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24155:x1874715939697408:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787869072.468224:0:22647:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787869072.468238:0:22647:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787869072.474836:0:22647:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787869072.474856:0:22647:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787869072.474968:0:22670:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787869072.474973:0:22670:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787869072.474994:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475013:0:22670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ec4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec46 expref: 21 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475021:0:22670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2ec5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec54 expref: 21 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475028:0:22670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475102:0:22670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2ec5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ec54 expref: 21 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475117:0:22670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2ec5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec54 expref: 21 pid: 22648 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869072.475177:0:22670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22670:1874715939697536:0@lo:104: 00000100:00100000:1.0:1787869072.475240:0:22670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787869072.475289:0:22670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ec4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ec46 expref: 21 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475297:0:22670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ec4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec46 expref: 21 pid: 22649 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869072.475304:0:22670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93093c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22670:1874715939697664:0@lo:104: 00000100:00100000:1.0:1787869072.475326:0:22670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869072.475342:0:22670:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa7e20a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787869072.475364:0:22638:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787869072.475392:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939697536 00000100:00100000:1.0:1787869072.475398:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939697536 00000100:00100000:1.0:1787869072.475429:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939697664 00000100:00100000:1.0:1787869072.475432:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939697664 00000100:00100000:1.0:1787869072.475446:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787869072.475454:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da930930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+4:22670:x1874715939697536:12345-0@lo:104: 00010000:00010000:1.0:1787869072.475465:0:22638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ec5b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475530:0:22638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787869072.475542:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da930930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+4:22670:x1874715939697536:12345-0@lo:104: Request processed in 88us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869072.475550:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787869072.475558:0:22670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93091e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22670:1874715939697536:0@lo:104: 00000100:00100000:1.0:1787869072.475566:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787869072.475572:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da8835bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+3:22670:x1874715939697664:12345-0@lo:104: 00010000:00010000:1.0:1787869072.475580:0:22638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ec4d expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475623:0:22638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787869072.475629:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da8835bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+3:22670:x1874715939697664:12345-0@lo:104: Request processed in 58us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869072.475635:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787869072.475673:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787869072.475679:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ec5b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475686:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a5000 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787869072.475690:0:22643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ec5b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475699:0:22643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ec5b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787869072.475707:0:22643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ec5b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869072.475713:0:22643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1787869072.475736:0:22670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93093c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22670:1874715939697664:0@lo:104: 00010000:00010000:1.0:1787869072.475739:0:22643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec5b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475755:0:22643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787869072.475756:0:22670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475779:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec5b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475786:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab52a5000/0x2f11f4d3bde2ec54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec5b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869072.475789:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1787869072.475796:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787869072.475798:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3637:1874715939697792:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787869072.475799:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ec4d expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475805:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a000 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787869072.475808:0:22643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ec4d expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475814:0:22643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ec4d expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787869072.475820:0:22643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ec4d expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869072.475825:0:22643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1787869072.475826:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787869072.475838:0:22643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec4d expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475844:0:22643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787869072.475852:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec4d expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869072.475853:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939697792 00000100:00100000:3.0:1787869072.475856:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939697792 00010000:00010000:1.0:1787869072.475859:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a000/0x2f11f4d3bde2ec46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec4d expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869072.475871:0:22640:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2ec5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec54 expref: 22 pid: 22648 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.475876:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869072.475877:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869072.475879:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869072.475885:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787869072.475892:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787869072.475898:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787869072.475904:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:3637:x1874715939697792:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787869072.475905:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939697920:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787869072.475913:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787869072.475918:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2ec5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec54 expref: 22 pid: 22648 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869072.475929:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2ec5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec54 expref: 22 pid: 22648 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869072.475930:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787869072.475942:0:22640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1be00/0x2f11f4d3bde2ec5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec54 expref: 22 pid: 22648 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869072.475952:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787869072.475956:0:22639:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787869072.475962:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787869072.475974:0:22641:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787869072.475976:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:3637:x1874715939697792:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869072.475980:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939697920 00000100:00100000:3.0:1787869072.475982:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787869072.475983:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939697920 00010000:00010000:1.0:1787869072.475995:0:22641:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ec4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec46 expref: 21 pid: 22649 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869072.476027:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787869072.476033:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:3636:x1874715939697920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787869072.476041:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787869072.476044:0:22641:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ec4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec46 expref: 21 pid: 22649 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.476053:0:22641:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ec4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec46 expref: 21 pid: 22649 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.476064:0:22641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ec4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec46 expref: 21 pid: 22649 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.476074:0:22641:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.476093:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787869072.476105:0:22641:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003106206s 00010000:00010000:1.0:1787869072.476109:0:22641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.476115:0:22641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.476122:0:22641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.476128:0:22641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.476132:0:22641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ac00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869072.476136:0:22641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.476143:0:22641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.476179:0:22641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869072.476183:0:22670:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869072.476189:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787869072.476190:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869072.476196:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1ac00/0x2f11f4d3bde2ed03 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869072.476216:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:3636:x1874715939697920:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869072.476223:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787869072.476395:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3637:1874715939697792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787869072.476413:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939697920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787869072.481624:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+19:24155:x1874715939697408:12345-0@lo:253:mount.lustre.0 Request processed in 13423us (14421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869072.481640:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787869072.481738:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24155:1874715939697408:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787869072.481753:0:24155:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787869072.481757:0:24155:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787869072.481758:0:24155:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787869072.481760:0:24155:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787869072.481761:0:24155:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787869072.481762:0:24155:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787869072.481769:0:24155:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787869072.481770:0:24155:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787869072.481772:0:24155:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787869072.481773:0:24155:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787869072.481790:0:24155:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1787869072.485276:0:24155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1787869072.489873:0:24155:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787869072.489884:0:24155:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787869072.489920:0:24155:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787869072.489964:0:24155:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787869072.489980:0:24155:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787869072.489995:0:24155:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787869072.492197:0:24155:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787869072.492446:0:24155:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787869073.185708:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787869073.185735:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939698048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787869073.185813:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869073.185911:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939698048 00000100:00100000:0.0:1787869073.185921:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939698048 00000100:00100000:0.0:1787869073.185977:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787869073.185987:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939698048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787869073.186027:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787869073.186079:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939698048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869073.186086:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787869073.186602:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939698048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787869073.186878:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939698176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787869073.186932:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869073.187056:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939698176 00000100:00100000:0.0:1787869073.187062:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939698176 00000100:00100000:0.0:1787869073.187098:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787869073.187106:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939698176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787869073.187129:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787869073.187204:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939698176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869073.187218:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787869073.187826:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939698176:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787869073.250420:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787869073.399008:0:24237:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787869073.399397:0:24237:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1787869074.213753:0:22651:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787869074.213760:0:22651:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93da88303000 from 13 10000000:01000000:0.0:1787869074.213766:0:22651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787869074.213811:0:22651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869074.213824:0:22651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869074.213835:0:22651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869074.213860:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f55e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939698304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787869074.213929:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869074.213973:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d981c2bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787869074.213992:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939698304 00000100:00100000:0.0:1787869074.213999:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939698304 00000100:00100000:0.0:1787869074.214052:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787869074.214061:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+19:22651:x1874715939698304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787869074.214079:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869074.214093:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93daace1ca00/0x2f11f4d3bde2ed11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ed0a expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869074.214116:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93daace1ca00/0x2f11f4d3bde2ed11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ed0a expref: 20 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869074.214126:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93daace1ca00/0x2f11f4d3bde2ed11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ed0a expref: 20 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869074.214148:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1ca00, rc 0) 00000100:00100000:0.0:1787869074.214240:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:22651:x1874715939698304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869074.214247:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787869074.214452:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f55e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939698304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787869074.214468:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ed11 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869074.214479:0:22651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ed11 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869074.214533:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939698432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787869074.214570:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869074.214597:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8c0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787869074.214647:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939698432 00000100:00100000:1.0:1787869074.214652:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939698432 00000100:00100000:1.0:1787869074.214696:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787869074.214705:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:22651:x1874715939698432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787869074.214719:0:22647:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787869074.214736:0:22647:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787869074.214739:0:22647:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1787869074.214838:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:22651:x1874715939698432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869074.214845:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787869074.215034:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939698432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787869074.215099:0:22651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787869074.215106:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ed11 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869074.215115:0:22651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ed11 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787869074.215126:0:22651:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787869074.215128:0:22651:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93dab523f000 from 13 10000000:01000000:0.0:1787869074.215131:0:22651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787869074.215152:0:22651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869074.215191:0:22651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869074.215199:0:22651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869074.215213:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939698560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787869074.215245:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869074.215281:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d981c2bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787869074.215387:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939698560 00000100:00100000:3.0:1787869074.215408:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939698560 00000100:00100000:3.0:1787869074.215444:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787869074.215453:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:22651:x1874715939698560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787869074.215462:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869074.215473:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ed1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ed18 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869074.215491:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ed1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ed18 expref: 21 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869074.215501:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ed1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ed18 expref: 21 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869074.215508:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dabd870800, rc 0) 00000100:00100000:3.0:1787869074.215546:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:22651:x1874715939698560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869074.215562:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787869074.215655:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939698560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787869074.215666:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ed1f expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869074.215674:0:22651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ed1f expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869074.215716:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f54780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939698688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787869074.215756:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869074.215777:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d981c2bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787869074.216078:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939698688 00000100:00100000:3.0:1787869074.216083:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939698688 00000100:00100000:3.0:1787869074.216118:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787869074.216126:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:22651:x1874715939698688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787869074.216138:0:22649:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787869074.216193:0:22649:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787869074.216197:0:22649:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1787869074.216278:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:22651:x1874715939698688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869074.216285:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787869074.216329:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f54780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939698688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787869074.216397:0:22651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787869074.216404:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ed1f expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869074.216414:0:22651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ed1f expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869074.281400:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787869074.661871:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787869075.306766:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869076.322065:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869077.345543:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787869077.794420:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787869077.794427:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787869077.794430:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787869077.794434:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787869077.794462:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787869077.794466:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787869077.794468:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787869077.794472:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787869077.794513:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939698944:0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.794589:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869077.794635:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939699456:0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.794661:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869077.794698:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787869077.794704:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3637:1874715939698816:0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.794734:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869077.794756:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939699328:0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.794778:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869077.794804:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939699072:0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.794827:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869077.794844:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939699584:0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.794865:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869077.794878:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787869077.794883:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939699200:0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.794904:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869077.794938:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939699456 00000100:00100000:2.0:1787869077.794945:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939699456 00000100:00100000:2.0:1787869077.794999:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939699328 00000100:00100000:2.0:1787869077.795003:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939699328 00000100:00100000:2.0:1787869077.795015:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939699072 00000100:00100000:2.0:1787869077.795017:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939699072 00000100:00100000:2.0:1787869077.795027:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939699584 00000100:00100000:2.0:1787869077.795029:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939699584 00000100:00100000:2.0:1787869077.795047:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787869077.795055:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939699456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.795107:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939699456:12345-0@lo:400:kworker.0 Request processed in 52us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869077.795114:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787869077.795130:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787869077.795137:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939699328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.795216:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939699328:12345-0@lo:400:kworker.0 Request processed in 79us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869077.795222:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787869077.795234:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787869077.795239:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939699072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.795269:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939699072:12345-0@lo:400:kworker.0 Request processed in 30us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869077.795288:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787869077.795299:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787869077.795306:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939699584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.795333:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939699584:12345-0@lo:400:kworker.0 Request processed in 29us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869077.795338:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787869077.795355:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939698816 00000100:00100000:2.0:1787869077.795358:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939698816 00000100:00100000:2.0:1787869077.795382:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787869077.795389:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:3637:x1874715939698816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.795418:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:3637:x1874715939698816:12345-0@lo:400:kworker.0 Request processed in 30us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869077.795424:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787869077.795460:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939698944 00000100:00100000:2.0:1787869077.795465:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939698944 00000100:00100000:2.0:1787869077.795481:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939699200 00000100:00100000:2.0:1787869077.795484:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939699200 00000100:00100000:2.0:1787869077.795495:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787869077.795501:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939698944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.795544:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939698944:12345-0@lo:400:kworker.0 Request processed in 43us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869077.795551:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787869077.795564:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787869077.795570:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939699200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.795597:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939699200:12345-0@lo:400:kworker.0 Request processed in 28us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869077.795603:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787869077.795644:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939699200:0@lo:400:kworker.0 00010000:00080000:2.0:1787869077.795658:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab7f59a40 x1874715939699072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869077.795669:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939699072:0@lo:400:kworker.0 00010000:00080000:2.0:1787869077.795679:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab7f59680 x1874715939699584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869077.795688:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939699584:0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.795719:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3637:1874715939698816:0@lo:400:kworker.0 00010000:00080000:2.0:1787869077.795730:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab7f58f00 x1874715939699328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869077.795737:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939699328:0@lo:400:kworker.0 00000100:00100000:2.0:1787869077.795746:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939698944:0@lo:400:kworker.0 00010000:00080000:2.0:1787869077.795756:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab7f5a1c0 x1874715939699456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869077.795777:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939699456:0@lo:400:kworker.0 00000100:00080000:3.0:1787869077.796949:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787869077.796957:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787869078.307042:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939699712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787869078.307120:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869078.307427:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939699712 00000100:00100000:3.0:1787869078.307435:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939699712 00000100:00100000:3.0:1787869078.307492:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787869078.307504:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939699712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787869078.307539:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787869078.307591:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939699712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869078.307598:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787869078.307641:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939699712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787869078.309499:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939699840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787869078.309564:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869078.310699:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939699840 00000100:00100000:3.0:1787869078.310709:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939699840 00000100:00100000:3.0:1787869078.310778:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787869078.310788:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93091e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939699840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787869078.310838:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787869078.310916:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93091e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939699840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869078.310923:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787869078.310971:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939699840:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787869078.380083:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787869079.203974:0:23410:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787869079.393323:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787869079.622519:0:24527:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787869080.425304:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787869080.521724:0:24580:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787869080.521960:0:24580:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787869081.443408:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787869081.609373:0:24631:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787869081.609696:0:24631:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787869082.470278:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787869082.723318:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787869067/real 1787869067] req@ffff93da93093480 x1874715939692544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869082 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869082.723356:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93da93093480 x1874715939692544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869082 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869082.723368:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787869067/real 1787869067] req@ffff93da93093840 x1874715939692672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869082 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869082.723381:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93da93093840 x1874715939692672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869082 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787869082.723405:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab5bc4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787869082.723427:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787869082.723432:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939692544:0@lo:8:kworker.0 00000100:00080000:3.0:1787869082.723438:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da88341000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787869082.723443:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787869082.723446:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93093840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939692672:0@lo:8:kworker.0 00000100:00080000:1.0:1787869082.723771:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869082.723776:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787869082.723778:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869082.723781:0:13937:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787869082.723793:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869082.723796:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787869082.723798:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93dab5bc4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787869082.723803:0:13937:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 691 00000100:00080000:1.0:1787869082.723808:0:13937:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787869082.723814:0:13937:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93dab5bc4000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787869082.723832:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da9336b0c0 x1874715939700480/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787869082.723842:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869082.723845:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787869082.723846:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93da88341000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787869082.723849:0:13937:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 691 00000100:00080000:1.0:1787869082.723851:0:13937:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787869082.723854:0:13937:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93da88341000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787869082.723862:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da9336ad00 x1874715939700608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787869082.723913:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93093840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939700096:0@lo:400:kworker.0 00000100:00100000:1.0:1787869082.723982:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869082.724026:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939700864:0@lo:400:kworker.0 00000100:00100000:1.0:1787869082.724055:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869082.724079:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787869082.724085:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939700224:0@lo:400:kworker.0 00000100:00100000:1.0:1787869082.724109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869082.724127:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939700992:0@lo:400:kworker.0 00000100:00100000:1.0:1787869082.724149:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869082.724214:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939700864 00000100:00100000:1.0:1787869082.724221:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939700864 00000100:00100000:1.0:1787869082.724267:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939700224 00000100:00100000:1.0:1787869082.724270:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939700224 00000100:00100000:1.0:1787869082.724479:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939700992 00000100:00100000:1.0:1787869082.724484:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939700992 00000100:00100000:1.0:1787869082.724501:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787869082.724509:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939700864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869082.724562:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874715939700864:12345-0@lo:400:kworker.0 Request processed in 53us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869082.724569:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787869082.724586:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787869082.724592:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939700224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869082.724618:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874715939700224:12345-0@lo:400:kworker.0 Request processed in 27us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869082.724624:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787869082.724645:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787869082.725102:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939700352:0@lo:400:kworker.0 00000100:00100000:0.0:1787869082.725188:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869082.725213:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787869082.725221:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939699968:0@lo:400:kworker.0 00000100:00100000:0.0:1787869082.725251:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869082.725298:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93369a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939700736:0@lo:400:kworker.0 00000100:00100000:0.0:1787869082.725323:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869082.725346:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939700096 00000100:00100000:0.0:1787869082.725351:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939700096 00000100:00100000:0.0:1787869082.725379:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939700352 00000100:00100000:0.0:1787869082.725382:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939700352 00000100:00100000:0.0:1787869082.725394:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787869082.725400:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93368780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939700096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869082.725439:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93368780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939700096:12345-0@lo:400:kworker.0 Request processed in 39us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869082.725454:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787869082.725467:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787869082.725472:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939700352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869082.725507:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939700352:12345-0@lo:400:kworker.0 Request processed in 34us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869082.725512:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787869082.725529:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939699968 00000100:00100000:0.0:1787869082.725532:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939699968 00000100:00100000:0.0:1787869082.725559:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787869082.725565:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:3636:x1874715939699968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869082.725592:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:3636:x1874715939699968:12345-0@lo:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869082.725598:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787869082.725677:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939699968:0@lo:400:kworker.0 00000100:00100000:0.0:1787869082.725689:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939700352:0@lo:400:kworker.0 00000100:00100000:1.0:1787869082.726479:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93369e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939700992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869082.726529:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93369e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939700992:12345-0@lo:400:kworker.0 Request processed in 60us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869082.726535:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787869082.726552:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939700736 00000100:00100000:1.0:1787869082.726556:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939700736 00000100:00100000:1.0:1787869082.726575:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787869082.726580:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939700736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869082.726617:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939700736:12345-0@lo:400:kworker.0 Request processed in 36us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869082.726623:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787869082.726863:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da93093480 x1874715939700224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787869082.726876:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874715939700224:0@lo:400:kworker.0 00010000:00080000:1.0:1787869082.726888:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da9336bc00 x1874715939700992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787869082.726896:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939700992:0@lo:400:kworker.0 00000100:00100000:1.0:1787869082.726913:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93093840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939700096:0@lo:400:kworker.0 00010000:00080000:1.0:1787869082.726924:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da93368f00 x1874715939700864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787869082.726933:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3638:1874715939700864:0@lo:400:kworker.0 00000100:00080000:3.0:1787869082.727050:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787869082.727056:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787869082.727084:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939700480:0@lo:8:kworker.0 00000100:00100000:3.0:1787869082.727146:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869082.727200:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939700608:0@lo:8:kworker.0 00000100:00100000:3.0:1787869082.727226:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869082.727293:0:24161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939700480 00000100:00100000:3.0:1787869082.727298:0:24161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939700480 00010000:00080000:0.0:1787869082.727380:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da93369a40 x1874715939700736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869082.727392:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93369a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939700736:0@lo:400:kworker.0 00000100:00100000:3.0:1787869082.742632:0:24161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939700608 00000100:00100000:3.0:1787869082.742718:0:24161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939700608 00000100:00100000:1.0:1787869082.742952:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787869082.742962:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939700480:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787869082.743003:0:24160:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 706 last 0 00000020:00000080:1.0:1787869082.743032:0:24160:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2ed26 00002000:00100000:1.0:1787869082.743049:0:24160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff93dabda35800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113963 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787869082.743053:0:24160:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787869082.743056:0:24160:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787869082.743304:0:24160:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787869082.743332:0:24160:0:(import.c:65:import_set_state_nolock()) ffff93dabda36000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787869082.743428:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1874715939700480:12345-0@lo:8:kworker.0 Request processed in 465us (16281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869082.743436:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787869082.743456:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787869082.743461:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939700608:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787869082.743474:0:24160:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1787869082.760602:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da9336b0c0 x1874715939700480/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787869102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869082.760616:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787869082.760627:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787869082.760638:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787869082.760644:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787869082.760660:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93dab5bc4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787869082.760684:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787869082.760691:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939700480:0@lo:8:kworker.0 00000004:00080000:3.0:1787869082.760769:0:23396:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787869082.760794:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c21c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23396:1874715939701248:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787869082.760855:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869082.760880:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd8603c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787869082.760894:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939701120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787869082.760918:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869082.760950:0:24162:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787869082.760957:0:24162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787869082.760981:0:24163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939701120 00000100:00100000:3.0:1787869082.760987:0:24163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939701120 00000100:00100000:3.0:1787869082.761056:0:24163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787869082.761065:0:24163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1874715939701120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787869082.761093:0:24163:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787869082.761138:0:24163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1874715939701120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869082.761144:0:24163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787869082.761426:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9888c3840 x1874715939701120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787869098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869082.761442:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939701120:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787869082.761482:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787869082.761491:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787869082.761498:0:24161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939701248 00000100:00100000:3.0:1787869082.761501:0:24161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939701248 00000100:00100000:3.0:1787869082.761619:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787869082.761627:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23396:x1874715939701248:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787869082.761883:0:23395:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787869082.761970:0:23395:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 706887813797ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787869082.761977:0:23395:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1787869082.770858:0:23387:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1787869082.790600:0:24665:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787869082.790611:0:24665:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787869082.790728:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23396:x1874715939701248:12345-0@lo:7:osp-pre-0-1.0 Request processed in 29097us (29868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869082.790739:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787869082.791001:0:23396:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9888c21c0 x1874715939701248/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787869098 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869082.791017:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c21c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23396:1874715939701248:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787869082.791031:0:23396:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787869082.791078:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23396:1874715939701376:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787869082.791123:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869082.791191:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da918253c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787869082.791889:0:24161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939701376 00000100:00100000:3.0:1787869082.791897:0:24161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939701376 00000100:00100000:3.0:1787869082.791944:0:24161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787869082.791953:0:24161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23396:x1874715939701376:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787869082.791999:0:24161:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1787869082.792061:0:24161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23396:x1874715939701376:12345-0@lo:5:osp-pre-0-1.0 Request processed in 107us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869082.792070:0:24161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787869082.792126:0:23396:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dabed0b480 x1874715939701376/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787869098 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869082.792140:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23396:1874715939701376:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787869082.792172:0:23396:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787869082.792220:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23396:1874715939701504:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787869082.792250:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869082.792267:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabd860c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787869082.792280:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939701504 00000100:00100000:3.0:1787869082.792283:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939701504 00000100:00100000:3.0:1787869082.792305:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787869082.792310:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23396:x1874715939701504:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787869082.792337:0:24665:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:1.0:1787869082.802096:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939700608:12345-0@lo:8:kworker.0 Request processed in 58627us (74862us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787869082.802111:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787869082.803064:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da88341000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787869082.803072:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787869082.803078:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939700608:0@lo:8:kworker.0 00000001:00080000:1.0:1787869082.855553:0:24156:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1787869082.855573:0:24156:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787869082.855804:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23396:x1874715939701504:12345-0@lo:5:osp-pre-0-1.0 Request processed in 63487us (63546us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787869082.855819:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787869082.856087:0:23396:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9888c3840 x1874715939701504/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787869098 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869082.856101:0:23396:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1787869082.856107:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c3840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23396:1874715939701504:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787869082.856121:0:23396:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1787869082.856222:0:23396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f55e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23396:1874715939701632:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787869082.856271:0:23396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869082.856316:0:23396:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daa0f40840 going to sleep for 11 seconds 00000100:00100000:1.0:1787869082.856505:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939701632 00000100:00100000:1.0:1787869082.856512:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939701632 00000100:00100000:1.0:1787869082.856569:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787869082.856580:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23396:x1874715939701632:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787869082.856639:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23396:x1874715939701632:12345-0@lo:900:osp-pre-0-1.0 Request processed in 61us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869082.856647:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787869082.856764:0:23396:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab6f55e00 x1874715939701632/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787869098 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869082.856774:0:23396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f55e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23396:1874715939701632:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787869083.425345:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787869083.425371:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939701760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787869083.425441:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869083.425490:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939701760 00000100:00100000:3.0:1787869083.425497:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939701760 00000100:00100000:3.0:1787869083.425547:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787869083.425563:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939701760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787869083.425610:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787869083.425666:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939701760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869083.425673:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787869083.426091:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9888c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939701760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787869083.428479:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787869083.428501:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939701888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787869083.428570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869083.428786:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939701888 00000100:00100000:2.0:1787869083.428794:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939701888 00000100:00100000:2.0:1787869083.428841:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787869083.428852:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939701888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787869083.428884:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787869083.428933:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939701888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869083.428940:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787869083.428992:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939701888:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787869083.497010:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869084.515454:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787869084.908121:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787869085.548663:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869086.570960:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869087.588906:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787869087.843088:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787869067/real 1787869067] req@ffff93da930921c0 x1874715939692928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869087 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869087.843126:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93da930921c0 x1874715939692928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869087 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869087.843137:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787869067/real 1787869067] req@ffff93da93090780 x1874715939693056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869087 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869087.843148:0:3635:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93da93090780 x1874715939693056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787869087 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787869087.843310:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d981c0d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787869087.843336:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787869087.843341:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da930921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939692928:0@lo:8:kworker.0 00000100:00080000:0.0:1787869087.843346:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d98895e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787869087.843351:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787869087.843354:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939693056:0@lo:8:kworker.0 00000100:00080000:1.0:1787869087.843527:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869087.843535:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787869087.843537:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93d981c0d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787869087.843542:0:13937:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 691 00000100:00080000:1.0:1787869087.843550:0:13937:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787869087.843558:0:13937:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d981c0d800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787869087.843579:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da933683c0 x1874715939702272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787869087.843591:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869087.843593:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787869087.843595:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93d98895e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787869087.843598:0:13937:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 691 00000100:00080000:1.0:1787869087.843600:0:13937:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787869087.843603:0:13937:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d98895e800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787869087.843613:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da9336a1c0 x1874715939702400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787869087.843639:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869087.843642:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787869087.843644:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93da88341000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787869087.843647:0:13937:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 706 00000100:00080000:1.0:1787869087.843650:0:13937:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787869087.843653:0:13937:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93da88341000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787869087.843664:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da9336ad00 x1874715939702912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787869087.843687:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939702144:0@lo:400:kworker.0 00000100:00100000:1.0:1787869087.843725:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939702528:0@lo:400:kworker.0 00000100:00100000:3.0:1787869087.843753:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869087.843754:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869087.843812:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939702016:0@lo:400:kworker.0 00000100:00100000:0.0:1787869087.843869:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939702656:0@lo:400:kworker.0 00000100:00100000:3.0:1787869087.847441:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939703040:0@lo:400:kworker.0 00000100:00100000:3.0:1787869087.847504:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869087.847556:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939702144 00000100:00100000:3.0:1787869087.847565:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939702144 00000100:00100000:3.0:1787869087.848358:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787869087.848368:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939702144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787869087.848447:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939702144:12345-0@lo:400:kworker.0 Request processed in 80us (4693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869087.848455:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787869087.849013:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939702528 00000100:00100000:3.0:1787869087.849021:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939702528 00000100:00100000:3.0:1787869087.849060:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939703040 00000100:00100000:3.0:1787869087.849063:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939703040 00000100:00100000:3.0:1787869087.849089:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787869087.849098:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988243840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939702528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787869087.849145:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988243840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939702528:12345-0@lo:400:kworker.0 Request processed in 49us (5389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869087.849725:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787869087.849746:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787869087.849754:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9888c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939703040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787869087.849797:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9888c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939703040:12345-0@lo:400:kworker.0 Request processed in 44us (2293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869087.849802:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787869087.849855:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da9336b0c0 x1874715939703040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869087.849871:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939703040:0@lo:400:kworker.0 00000100:00100000:3.0:1787869087.849885:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939702144:0@lo:400:kworker.0 00000100:00100000:3.0:1787869087.850071:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da933683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939702272:0@lo:8:kworker.0 00000100:00100000:3.0:1787869087.850125:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869087.851305:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939702400:0@lo:8:kworker.0 00000100:00100000:3.0:1787869087.851362:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869087.851400:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9336ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939702912:0@lo:8:kworker.0 00010000:00080000:1.0:1787869087.851423:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da93369680 x1874715939702528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869087.851424:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869087.851437:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939702528:0@lo:400:kworker.0 00000100:00100000:1.0:1787869087.851445:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93369a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939703168:0@lo:400:kworker.0 00000100:00100000:3.0:1787869087.851458:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939702272 00000100:00100000:3.0:1787869087.851464:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939702272 00000100:00100000:1.0:1787869087.851471:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869087.851490:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939702400 00000100:00100000:3.0:1787869087.851492:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939702400 00000100:00100000:3.0:1787869087.851500:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939702912 00000100:00100000:3.0:1787869087.851502:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939702912 00000100:00100000:3.0:1787869087.851511:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787869087.851517:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3635:x1874715939702272:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787869087.851518:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787869087.851522:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939702400:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787869087.851601:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869087.851627:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939702016 00000100:00100000:2.0:1787869087.851630:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939702016 00000100:00100000:2.0:1787869087.851661:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787869087.851668:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:3639:x1874715939702016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787869087.851714:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:3639:x1874715939702016:12345-0@lo:400:kworker.0 Request processed in 47us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869087.851720:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787869087.851758:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939702016:0@lo:400:kworker.0 00000100:00100000:2.0:1787869087.851766:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939702784:0@lo:400:kworker.0 00000100:00100000:2.0:1787869087.851790:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869087.851809:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787869087.851816:0:24161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1787869087.851870:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939703168 00000100:00100000:2.0:1787869087.851875:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939703168 00000100:00100000:2.0:1787869087.851923:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787869087.851930:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939703168:12345-0@lo:400:kworker.0 00010000:00020000:1.0:1787869087.852074:0:24160:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787869087.852122:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939702400:12345-0@lo:8:kworker.0 Request processed in 598us (760us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787869087.852129:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787869087.852143:0:24160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939702784 00000100:00100000:1.0:1787869087.852146:0:24160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939702784 00000100:00100000:1.0:1787869087.852203:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787869087.852210:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939702784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869087.852243:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939702784:12345-0@lo:400:kworker.0 Request processed in 33us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869087.852249:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787869087.852262:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787869087.852266:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939702912:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787869087.852323:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939703168:12345-0@lo:400:kworker.0 Request processed in 393us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869087.852329:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787869087.852361:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da93369a40 x1874715939703168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869087.852386:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93369a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939703168:0@lo:400:kworker.0 00010000:00080000:2.0:1787869087.852412:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da93368f00 x1874715939702784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787869103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869087.852421:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939702784:0@lo:400:kworker.0 00000100:00080000:2.0:1787869087.852443:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787869087.852448:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787869087.852631:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d98895e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787869087.852636:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787869087.852640:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939702400:0@lo:8:kworker.0 00000100:00100000:0.0:1787869087.853178:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869087.853340:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939703296:0@lo:400:kworker.0 00000100:00100000:0.0:1787869087.853373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869087.853488:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939702656 00000100:00100000:2.0:1787869087.853495:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939702656 00000100:00100000:2.0:1787869087.853533:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787869087.853541:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939702656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787869087.853594:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939702656:12345-0@lo:400:kworker.0 Request processed in 53us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869087.853600:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787869087.853699:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939702656:0@lo:400:kworker.0 00000100:00100000:0.0:1787869087.854388:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939703296 00000100:00100000:0.0:1787869087.854394:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939703296 00000100:00100000:0.0:1787869087.854448:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787869087.854457:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939703296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869087.854504:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874715939703296:12345-0@lo:400:kworker.0 Request processed in 50us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869087.854511:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787869087.854547:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d988240000 x1874715939703296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869087.854559:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3638:1874715939703296:0@lo:400:kworker.0 00000100:00080000:2.0:1787869087.854615:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787869087.857794:0:24162:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 711 last 0 00010000:00020000:1.0:1787869087.857842:0:24160:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:3.0:1787869087.857855:0:24162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2ed2d 00002000:00100000:3.0:1787869087.857873:0:24162:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93da82cd5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113963 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787869087.857877:0:24162:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787869087.857880:0:24162:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1787869087.858176:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da88341000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787869087.858313:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787869087.858320:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9336ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939702912:0@lo:8:kworker.0 00000100:00100000:1.0:1787869087.858399:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939702912:12345-0@lo:8:kworker.0 Request processed in 5689us (6532us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787869087.858410:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00002000:00080000:3.0:1787869087.858544:0:24162:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787869087.858568:0:24162:0:(import.c:65:import_set_state_nolock()) ffff93da82cd7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787869087.859354:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1874715939702272:12345-0@lo:8:kworker.0 Request processed in 7834us (9227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869087.859363:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787869087.860115:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da933683c0 x1874715939702272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787869112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869087.860126:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787869087.860135:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787869087.860153:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787869087.860181:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787869087.860193:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d981c0d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787869087.860218:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787869087.860224:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da933683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939702272:0@lo:8:kworker.0 00000004:00080000:0.0:1787869087.860274:0:22678:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787869087.860361:0:22678:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 711986204775ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787869087.860369:0:22678:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787869087.860491:0:22679:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:3.0:1787869087.860516:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22679:1874715939703552:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787869087.860829:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939703424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787869087.860866:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869087.860999:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869087.861025:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae7a66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787869087.861128:0:24163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939703424 00000100:00100000:3.0:1787869087.861135:0:24163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939703424 00000100:00100000:3.0:1787869087.861287:0:24163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787869087.861295:0:24163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939703424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787869087.861318:0:24163:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787869087.861359:0:24163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874715939703424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869087.861365:0:24163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787869087.861387:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787869087.861733:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939703552 00000100:00100000:0.0:1787869087.861738:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939703552 00000100:00100000:0.0:1787869087.861767:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787869087.861784:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22679:x1874715939703552:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:0.0:1787869087.867731:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da9393da40 x1874715939703424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787869103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869087.867776:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939703424:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1787869087.875196:0:24665:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787869087.875211:0:24665:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1787869087.875218:0:24665:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:2.0:1787869087.879143:0:22634:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787869087.890399:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869087.890411:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a06c633/0x2f11f4d3bde2ed34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.890428:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1787869087.890433:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869087.890440:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a06c633/0x2f11f4d3bde2ed34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.890458:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a06c633/0x2f11f4d3bde2ed34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.890470:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a06c633/0x2f11f4d3bde2ed34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.890478:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a06c633/0x2f11f4d3bde2ed34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.890507:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787869087.891576:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869087.891587:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a06c633/0x2f11f4d3bde2ed34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.891598:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1be00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787869087.891603:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a06c633/0x2f11f4d3bde2ed34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.891613:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a06c633/0x2f11f4d3bde2ed34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.891636:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a06c633/0x2f11f4d3bde2ed34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.891645:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a06c633/0x2f11f4d3bde2ed34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.891667:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869087.891670:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869087.891671:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869087.901884:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869087.901901:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.901919:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1787869087.901932:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869087.901939:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.901957:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.901969:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.901977:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.901997:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787869087.902010:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869087.902016:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.902037:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.902041:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.902051:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.902067:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.902097:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.902114:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.902116:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.902117:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869087.902710:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869087.902718:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.902729:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1787869087.902733:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869087.902738:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.902748:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.902757:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.902764:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.902787:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787869087.902909:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869087.902916:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.902930:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869087.902933:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.902941:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.902955:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed42 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.902963:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.902980:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.902981:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.902983:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869087.903335:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869087.903346:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.903355:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1787869087.903358:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869087.903363:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.903372:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.903380:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.903387:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.903411:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787869087.903538:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869087.903544:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.903551:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869087.903555:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.903563:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.903592:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.903600:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.903614:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.903616:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.903617:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787869087.906757:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869087.906773:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009406369a/0x2f11f4d3bde2ed50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.906789:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1787869087.906794:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869087.906800:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009406369a/0x2f11f4d3bde2ed50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.906813:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009406369a/0x2f11f4d3bde2ed50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.906822:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009406369a/0x2f11f4d3bde2ed50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.906829:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009406369a/0x2f11f4d3bde2ed50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.906860:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787869087.907469:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869087.907476:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907486:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1787869087.907490:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869087.907494:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907503:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907511:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907518:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907534:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787869087.907544:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787869087.907550:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009406369a/0x2f11f4d3bde2ed50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907557:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869087.907567:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009406369a/0x2f11f4d3bde2ed50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907590:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009406369a/0x2f11f4d3bde2ed50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907608:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009406369a/0x2f11f4d3bde2ed50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907615:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009406369a/0x2f11f4d3bde2ed50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907634:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869087.907637:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907643:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869087.907646:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907653:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907662:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907668:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.907687:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.907689:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.907690:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787869087.909497:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869087.909509:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.909526:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1787869087.909530:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869087.909537:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.909551:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.909562:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.910131:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.910281:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787869087.910296:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869087.910302:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.910322:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869087.910328:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.910339:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.910361:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.910369:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.910387:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.910388:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.910390:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869087.910636:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869087.914539:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869087.914555:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5479f15/0x2f11f4d3bde2ed65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.914589:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1787869087.914595:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869087.914601:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5479f15/0x2f11f4d3bde2ed65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.914615:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5479f15/0x2f11f4d3bde2ed65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.914636:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5479f15/0x2f11f4d3bde2ed65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.914644:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5479f15/0x2f11f4d3bde2ed65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.914662:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787869087.915789:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869087.915800:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.915815:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1787869087.915819:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869087.915825:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.915837:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.915845:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.915852:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.915884:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787869087.916351:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869087.916359:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.916370:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1787869087.916373:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869087.916377:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.916387:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.916395:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.916402:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.916427:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787869087.916445:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787869087.916452:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5479f15/0x2f11f4d3bde2ed65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.916460:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871c00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.916472:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5479f15/0x2f11f4d3bde2ed65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.916482:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5479f15/0x2f11f4d3bde2ed65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.916504:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5479f15/0x2f11f4d3bde2ed65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.916512:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5479f15/0x2f11f4d3bde2ed65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.916530:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787869087.916533:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.916540:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.916544:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.916551:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.916560:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.916567:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006377d770/0x2f11f4d3bde2ed6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.916726:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869087.916734:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.916741:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd871800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869087.916743:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.916751:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.916772:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.916779:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d3fd61/0x2f11f4d3bde2ed73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.916793:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.916795:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.916797:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.916805:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.917464:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.917466:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.917468:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869087.918915:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869087.918929:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.918945:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1787869087.918949:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869087.918957:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.918971:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.918979:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.918986:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.919009:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787869087.919168:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869087.919185:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.919194:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869087.919198:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.919206:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.919224:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed7a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.919232:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d019d61/0x2f11f4d3bde2ed7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.919265:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.919267:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.919269:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869087.919859:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869087.919867:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2ed81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.919890:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1787869087.919894:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869087.919899:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2ed81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.919911:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2ed81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.919920:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2ed81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.919929:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2ed81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.919987:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787869087.929024:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869087.929040:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2ed81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.929055:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869087.929060:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2ed81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.929072:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2ed81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.929106:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2ed81 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.929115:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7d1acc1/0x2f11f4d3bde2ed81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.929542:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869087.929545:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869087.929547:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787869087.930220:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869087.930229:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.930244:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1787869087.930253:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869087.930260:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.930275:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.930286:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.930293:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.930311:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787869087.931829:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869087.931840:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.931855:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=712s v=(0 0) 00010000:00010000:1.0:1787869087.931859:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869087.931866:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.931878:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.931888:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.931900:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.931924:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787869087.932352:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787869087.932360:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.932370:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.932375:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.932384:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.932416:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed88 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.932424:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006202f42b/0x2f11f4d3bde2ed88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.932442:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869087.932446:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.932453:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.932456:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.932463:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.932473:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.932479:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ed8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.932491:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.932494:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.932501:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869087.934677:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869087.934846:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869087.934857:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2ed96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.934876:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1787869087.934881:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869087.934888:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2ed96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.934903:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2ed96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.934915:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2ed96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.934924:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2ed96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.934948:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787869087.935619:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787869087.935628:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069c9a361/0x2f11f4d3bde2ed9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.935647:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1787869087.935651:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787869087.935655:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069c9a361/0x2f11f4d3bde2ed9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.935666:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069c9a361/0x2f11f4d3bde2ed9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.935676:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069c9a361/0x2f11f4d3bde2ed9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.935683:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069c9a361/0x2f11f4d3bde2ed9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.935705:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787869087.936051:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787869087.936060:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2ed96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.936069:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.936074:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2ed96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.936106:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2ed96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.936125:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2ed96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.936133:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a22ba2bb/0x2f11f4d3bde2ed96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.936149:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869087.936336:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069c9a361/0x2f11f4d3bde2ed9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.936345:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1da00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.936349:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069c9a361/0x2f11f4d3bde2ed9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.936357:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069c9a361/0x2f11f4d3bde2ed9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.936368:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069c9a361/0x2f11f4d3bde2ed9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.936374:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069c9a361/0x2f11f4d3bde2ed9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.936397:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.936399:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.936401:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869087.938985:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869087.938999:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2eda4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.939016:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1787869087.939021:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869087.939029:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2eda4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.939043:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2eda4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.939053:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2eda4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.939061:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2eda4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.939106:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787869087.939266:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787869087.939274:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2eda4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.939282:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787869087.939286:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2eda4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.939294:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2eda4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.939317:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2eda4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.939324:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de0e51d9/0x2f11f4d3bde2eda4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.939343:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869087.939353:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869087.939354:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.944521:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869087.945325:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869087.945337:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcb4c791/0x2f11f4d3bde2edab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.945366:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=712s v=(0 0) 00010000:00010000:3.0:1787869087.945370:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869087.945377:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcb4c791/0x2f11f4d3bde2edab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.945392:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcb4c791/0x2f11f4d3bde2edab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.945403:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcb4c791/0x2f11f4d3bde2edab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.945411:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcb4c791/0x2f11f4d3bde2edab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.945432:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787869087.946606:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869087.946617:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcb4c791/0x2f11f4d3bde2edab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.946628:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869087.946632:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcb4c791/0x2f11f4d3bde2edab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.946642:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcb4c791/0x2f11f4d3bde2edab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.946663:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcb4c791/0x2f11f4d3bde2edab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.946669:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcb4c791/0x2f11f4d3bde2edab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.946686:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.946687:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.946689:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787869087.946998:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869087.947006:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a772ba54/0x2f11f4d3bde2edb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.947017:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1787869087.947021:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869087.947028:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a772ba54/0x2f11f4d3bde2edb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.947040:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a772ba54/0x2f11f4d3bde2edb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.947048:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a772ba54/0x2f11f4d3bde2edb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.947055:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a772ba54/0x2f11f4d3bde2edb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.947090:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787869087.949330:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869087.949346:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a772ba54/0x2f11f4d3bde2edb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.949358:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a4400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.949363:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a772ba54/0x2f11f4d3bde2edb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.949374:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a772ba54/0x2f11f4d3bde2edb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.949419:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a772ba54/0x2f11f4d3bde2edb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.949427:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a772ba54/0x2f11f4d3bde2edb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.949453:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.949455:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.949457:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787869087.951429:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869087.951442:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f21c593b/0x2f11f4d3bde2edb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.951459:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1787869087.951464:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869087.951471:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f21c593b/0x2f11f4d3bde2edb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.951496:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f21c593b/0x2f11f4d3bde2edb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.951506:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f21c593b/0x2f11f4d3bde2edb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.951513:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f21c593b/0x2f11f4d3bde2edb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.951539:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787869087.951964:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869087.951971:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179fa47f/0x2f11f4d3bde2edc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.951981:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1787869087.951984:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869087.951989:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000179fa47f/0x2f11f4d3bde2edc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.951998:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000179fa47f/0x2f11f4d3bde2edc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.952005:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179fa47f/0x2f11f4d3bde2edc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.952023:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000179fa47f/0x2f11f4d3bde2edc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.952048:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787869087.952335:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869087.952341:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccb35ccd/0x2f11f4d3bde2edc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.952350:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1787869087.952354:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869087.952358:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccb35ccd/0x2f11f4d3bde2edc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.952367:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccb35ccd/0x2f11f4d3bde2edc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.952374:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccb35ccd/0x2f11f4d3bde2edc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.952382:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccb35ccd/0x2f11f4d3bde2edc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.952393:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787869087.952604:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787869087.952611:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f21c593b/0x2f11f4d3bde2edb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952620:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a5600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.952624:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f21c593b/0x2f11f4d3bde2edb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952634:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f21c593b/0x2f11f4d3bde2edb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952651:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f21c593b/0x2f11f4d3bde2edb9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952659:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f21c593b/0x2f11f4d3bde2edb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952688:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787869087.952691:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000179fa47f/0x2f11f4d3bde2edc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952698:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a4e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.952701:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000179fa47f/0x2f11f4d3bde2edc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952708:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000179fa47f/0x2f11f4d3bde2edc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952717:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000179fa47f/0x2f11f4d3bde2edc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952723:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000179fa47f/0x2f11f4d3bde2edc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952732:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869087.952735:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccb35ccd/0x2f11f4d3bde2edc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952741:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a5c00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.952744:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccb35ccd/0x2f11f4d3bde2edc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952760:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccb35ccd/0x2f11f4d3bde2edc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952769:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccb35ccd/0x2f11f4d3bde2edc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952776:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccb35ccd/0x2f11f4d3bde2edc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.952786:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.952787:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.952789:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.952796:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787869087.952961:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869087.952967:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d24db9e0/0x2f11f4d3bde2edce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.952980:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1787869087.952983:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869087.952988:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d24db9e0/0x2f11f4d3bde2edce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.952997:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d24db9e0/0x2f11f4d3bde2edce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.953005:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d24db9e0/0x2f11f4d3bde2edce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.953013:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d24db9e0/0x2f11f4d3bde2edce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.953031:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787869087.953328:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869087.953335:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d24db9e0/0x2f11f4d3bde2edce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.953343:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a4000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869087.953347:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d24db9e0/0x2f11f4d3bde2edce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.953355:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d24db9e0/0x2f11f4d3bde2edce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.953368:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d24db9e0/0x2f11f4d3bde2edce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.953374:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d24db9e0/0x2f11f4d3bde2edce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.953389:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.953391:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.953392:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.953440:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787869087.956547:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869087.956560:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007615a349/0x2f11f4d3bde2edd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.956577:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1787869087.956582:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869087.956588:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007615a349/0x2f11f4d3bde2edd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.956601:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007615a349/0x2f11f4d3bde2edd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.956630:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007615a349/0x2f11f4d3bde2edd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.956637:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007615a349/0x2f11f4d3bde2edd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.956659:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787869087.957065:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869087.957072:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007615a349/0x2f11f4d3bde2edd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.957093:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a4a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.957098:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007615a349/0x2f11f4d3bde2edd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.957107:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007615a349/0x2f11f4d3bde2edd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.957127:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007615a349/0x2f11f4d3bde2edd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.957144:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007615a349/0x2f11f4d3bde2edd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.957192:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.957195:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.957196:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787869087.957725:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869087.957735:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eddc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.957746:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1787869087.957749:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869087.957754:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.957764:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.957771:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.957778:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.957849:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787869087.961474:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869087.961493:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.961508:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a5200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869087.961513:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.961548:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eddc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.961573:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eddc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.961580:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eddc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869087.961605:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.961607:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869087.961609:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787869087.963421:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787869087.963437:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e794125/0x2f11f4d3bde2ede3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.963454:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=712s v=(0 0) 00010000:00010000:0.0:1787869087.963459:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787869087.963465:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e794125/0x2f11f4d3bde2ede3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.963480:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e794125/0x2f11f4d3bde2ede3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.963504:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e794125/0x2f11f4d3bde2ede3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.963511:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e794125/0x2f11f4d3bde2ede3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869087.963537:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787869087.963979:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869087.963987:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e794125/0x2f11f4d3bde2ede3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.963996:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1dc00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.964001:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e794125/0x2f11f4d3bde2ede3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.964010:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e794125/0x2f11f4d3bde2ede3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.964026:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e794125/0x2f11f4d3bde2ede3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.964034:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e794125/0x2f11f4d3bde2ede3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.964051:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.964053:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.964055:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787869087.965854:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869087.965865:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031361a63/0x2f11f4d3bde2edea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.965881:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1787869087.965886:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869087.965891:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031361a63/0x2f11f4d3bde2edea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.965904:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031361a63/0x2f11f4d3bde2edea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.965915:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031361a63/0x2f11f4d3bde2edea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.965923:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031361a63/0x2f11f4d3bde2edea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.965974:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787869087.970836:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869087.970852:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a79bdf26/0x2f11f4d3bde2edf1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.974217:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1787869087.974240:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869087.974250:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a79bdf26/0x2f11f4d3bde2edf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.974271:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a79bdf26/0x2f11f4d3bde2edf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.974282:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a79bdf26/0x2f11f4d3bde2edf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.974290:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a79bdf26/0x2f11f4d3bde2edf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.974535:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787869087.974543:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031361a63/0x2f11f4d3bde2edea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.974553:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a5e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.974557:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031361a63/0x2f11f4d3bde2edea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.974567:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031361a63/0x2f11f4d3bde2edea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.974585:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031361a63/0x2f11f4d3bde2edea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.974593:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031361a63/0x2f11f4d3bde2edea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.977389:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869087.977403:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a79bdf26/0x2f11f4d3bde2edf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.977417:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a5000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.977421:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a79bdf26/0x2f11f4d3bde2edf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.977433:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a79bdf26/0x2f11f4d3bde2edf1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.977477:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a79bdf26/0x2f11f4d3bde2edf1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.977488:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.977490:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.977492:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869087.977711:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787869087.977719:0:24665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a79bdf26/0x2f11f4d3bde2edf1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787869087.979460:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869087.979475:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025d6d5bb/0x2f11f4d3bde2edf8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.979491:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1787869087.979496:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869087.979503:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025d6d5bb/0x2f11f4d3bde2edf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.979515:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025d6d5bb/0x2f11f4d3bde2edf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.979538:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025d6d5bb/0x2f11f4d3bde2edf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.979544:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025d6d5bb/0x2f11f4d3bde2edf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.987979:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869087.987994:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025d6d5bb/0x2f11f4d3bde2edf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.988010:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a5800 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.988015:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d6d5bb/0x2f11f4d3bde2edf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.988027:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d6d5bb/0x2f11f4d3bde2edf8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.988051:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025d6d5bb/0x2f11f4d3bde2edf8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.988061:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.988063:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.988065:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869087.988391:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787869087.988399:0:24665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025d6d5bb/0x2f11f4d3bde2edf8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787869087.989072:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869087.989093:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000754a881f/0x2f11f4d3bde2edff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.989106:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1787869087.989111:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869087.989117:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000754a881f/0x2f11f4d3bde2edff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.989129:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000754a881f/0x2f11f4d3bde2edff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.989137:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000754a881f/0x2f11f4d3bde2edff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.989249:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000754a881f/0x2f11f4d3bde2edff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.990940:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869087.990952:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000754a881f/0x2f11f4d3bde2edff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.990980:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a4200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.990984:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000754a881f/0x2f11f4d3bde2edff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.990995:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000754a881f/0x2f11f4d3bde2edff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.991014:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000754a881f/0x2f11f4d3bde2edff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.991024:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.991025:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869087.991027:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869087.991126:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787869087.991134:0:24665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000754a881f/0x2f11f4d3bde2edff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787869087.993801:0:24665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869087.993813:0:24665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2ee06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.993829:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1787869087.993833:0:24665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869087.993840:0:24665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2ee06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.993853:0:24665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2ee06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.993863:0:24665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2ee06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.993871:0:24665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2ee06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.994345:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869087.994354:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2ee06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.994363:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a5200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869087.994368:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2ee06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.994378:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2ee06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869087.994396:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2ee06 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869087.994491:0:24665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787869087.994497:0:24665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2ee06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787869087.994587:0:24665:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:2.0:1787869087.994674:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22679:x1874715939703552:12345-0@lo:5:osp-pre-0-0.0 Request processed in 132897us (133671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869087.994683:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787869087.994768:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22679:1874715939703552:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787869087.994782:0:22679:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:3.0:1787869087.994826:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22679:1874715939703680:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787869087.994857:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869087.994883:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae7a66c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787869087.994895:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869087.994986:0:24907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939703680 00000100:00100000:2.0:1787869087.994993:0:24907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939703680 00000100:00100000:2.0:1787869087.995044:0:24907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787869087.995053:0:24907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22679:x1874715939703680:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787869087.995100:0:24907:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:1.0:1787869088.001863:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869088.001876:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869088.001879:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787869088.002360:0:24156:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1787869088.002421:0:24156:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787869088.007130:0:24907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:22679:x1874715939703680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12065us (12259us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787869088.007144:0:24907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787869088.007931:0:22679:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1787869088.007941:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22679:1874715939703680:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787869088.007958:0:22679:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:0.0:1787869088.037670:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787869088.037695:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939703808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787869088.037763:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869088.037849:0:24163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939703808 00000100:00100000:3.0:1787869088.037859:0:24163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939703808 00000100:00100000:3.0:1787869088.037912:0:24163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787869088.037921:0:24163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939703808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787869088.037943:0:24163:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787869088.037991:0:24163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939703808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869088.037998:0:24163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787869088.038045:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939703808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787869088.546322:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787869088.546350:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939703936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787869088.546442:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869088.546607:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939703936 00000100:00100000:3.0:1787869088.546615:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939703936 00000100:00100000:3.0:1787869088.546670:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787869088.546680:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939703936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787869088.546715:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787869088.546777:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939703936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869088.546785:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787869088.546864:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939704064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787869088.546893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869088.547039:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939704064 00000100:00100000:3.0:1787869088.547044:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939704064 00000100:00100000:3.0:1787869088.547077:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787869088.547086:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939704064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787869088.547104:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787869088.547139:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939704064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869088.547146:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787869088.547215:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939704064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787869088.548327:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939703936:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787869088.611988:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787869088.972448:0:24978:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787869088.972452:0:24978:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787869088.972454:0:24978:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787869088.972713:0:24978:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d987ee3000 00000020:01000004:2.0:1787869088.972809:0:24978:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787869088.972826:0:24978:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787869088.972838:0:24978:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93da86efced8) 00000020:00000080:2.0:1787869088.972856:0:24978:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787869089.040006:0:24978:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787869089.047216:0:24978:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787869089.048885:0:24978:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787869089.049134:0:24978:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787869089.050184:0:24978:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787869089.050501:0:24978:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787869089.051343:0:24978:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1787869089.053470:0:24978:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787869089.053703:0:24978:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787869089.053727:0:24978:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787869089.053738:0:24978:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2f11f4d3bde2ee14 00000020:01000004:1.0:1787869089.053744:0:24978:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787869089.053765:0:24978:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.127@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787869089.053768:0:24978:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787869089.053773:0:24978:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787869089.053799:0:24978:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1787869089.053803:0:24978:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787869089.066444:0:24978:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787869089.066638:0:24978:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.127@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787869089.066643:0:24978:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787869089.066649:0:24978:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787869089.066650:0:24978:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787869089.066651:0:24978:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787869089.066652:0:24978:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787869089.066654:0:24978:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787869089.066655:0:24978:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787869089.066657:0:24978:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787869089.066658:0:24978:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787869089.066662:0:24978:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787869089.066664:0:24978:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787869089.066665:0:24978:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787869089.066665:0:24978:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787869089.066666:0:24978:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787869089.066667:0:24978:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787869089.066668:0:24978:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787869089.066668:0:24978:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787869089.066669:0:24978:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787869089.066670:0:24978:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787869089.066705:0:24978:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787869089.066729:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939704192:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787869089.066797:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869089.066900:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae60ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787869089.066943:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939704192 00000100:00100000:0.0:1787869089.066950:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939704192 00000100:00100000:0.0:1787869089.067028:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787869089.067063:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24978:x1874715939704192:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787869089.067092:0:22647:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787869089.067095:0:22647:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787869089.067098:0:22647:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787869089.067446:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24978:x1874715939704192:12345-0@lo:253:mount.lustre.0 Request processed in 409us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869089.067454:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787869089.067538:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939704192:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787869089.067547:0:24978:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787869089.067549:0:24978:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787869089.067656:0:24978:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787869089.067657:0:24978:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787869089.067658:0:24978:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787869089.067659:0:24978:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787869089.067660:0:24978:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787869089.067661:0:24978:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787869089.067662:0:24978:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787869089.067663:0:24978:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787869089.067682:0:24978:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d987ee3000 from lustre-OST0001 10000000:01000000:2.0:1787869089.067708:0:24978:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787869089.067711:0:24978:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787869089.067718:0:24978:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93dabd2f9a48 local copy 00010000:00010000:2.0:1787869089.067735:0:24978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea55 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869089.067809:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939704320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787869089.067837:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869089.067897:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da921df0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787869089.067929:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939704320 00000100:00100000:0.0:1787869089.067933:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939704320 00000100:00100000:0.0:1787869089.067985:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787869089.067993:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24978:x1874715939704320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787869089.068078:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24978:x1874715939704320:12345-0@lo:501:mount.lustre.0 Request processed in 85us (239us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787869089.068085:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787869089.068184:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939704320:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787869089.068200:0:24978:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787869089.068219:0:24978:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787869089.068225:0:24978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea55 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.068232:0:24978:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93daace1c800/0x2f11f4d3bde2ea4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ea55 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869089.068257:0:24978:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d987ee3000 10000000:01000000:1.0:1787869089.068262:0:24978:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787869089.068267:0:24978:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787869089.068269:0:24978:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787869089.068273:0:24978:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787869089.068276:0:24978:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787869089.068296:0:24978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2ee1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.068303:0:24978:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2ee1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.068319:0:24978:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2ee1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869089.068331:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939704448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787869089.068360:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869089.068798:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da83d7ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787869089.068878:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939704448 00000100:00100000:2.0:1787869089.068883:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939704448 00000100:00100000:2.0:1787869089.068909:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787869089.068917:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:24978:x1874715939704448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787869089.068927:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869089.068940:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab52a5000/0x2f11f4d3bde2ee22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ee1b expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869089.068960:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab52a5000/0x2f11f4d3bde2ee22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ee1b expref: 22 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869089.068969:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab52a5000/0x2f11f4d3bde2ee22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ee1b expref: 22 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869089.068977:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a5000, rc 0) 00000100:00100000:2.0:1787869089.069016:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:24978:x1874715939704448:12345-0@lo:101:mount.lustre.0 Request processed in 100us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869089.069022:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787869089.069098:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939704448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787869089.069110:0:24978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2ee1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee22 expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.069119:0:24978:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2ee1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ee22 expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787869089.070382:0:24978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1787869089.071077:0:24978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787869089.073105:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787869089.073149:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787869089.074478:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787869089.074492:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787869089.074638:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787869089.074662:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787869089.074677:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787869089.074695:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787869089.074711:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1787869089.074738:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1787869089.074744:0:24978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1787869089.074851:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939704576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787869089.074922:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869089.075032:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da83d7ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787869089.075082:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939704576 00000100:00100000:2.0:1787869089.075089:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939704576 00000100:00100000:0.0:1787869089.075346:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787869089.075359:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:24978:x1874715939704576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787869089.075730:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:24978:x1874715939704576:12345-0@lo:501:mount.lustre.0 Request processed in 374us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869089.075738:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787869089.075814:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939704576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787869089.075849:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939704704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787869089.075893:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869089.075962:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da83d7ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787869089.075992:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939704704 00000100:00100000:3.0:1787869089.075997:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939704704 00000100:00100000:3.0:1787869089.076066:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787869089.076075:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:24978:x1874715939704704:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787869089.076992:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:24978:x1874715939704704:12345-0@lo:503:mount.lustre.0 Request processed in 916us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869089.077002:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787869089.077176:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939704704:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787869089.077839:0:24978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787869089.077924:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939704832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869089.077982:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869089.078087:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daafebfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787869089.078290:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939704832 00000100:00100000:3.0:1787869089.078296:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939704832 00000100:00100000:3.0:1787869089.078340:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787869089.078350:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:24978:x1874715939704832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787869089.078942:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:24978:x1874715939704832:12345-0@lo:502:mount.lustre.0 Request processed in 592us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869089.078951:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787869089.079053:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939704832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787869089.079307:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787869089.079335:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787869089.079349:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787869089.079365:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787869089.079376:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787869089.079386:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787869089.079397:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787869089.079408:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787869089.079418:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1787869089.079442:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939704960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869089.079479:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869089.079505:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da83d7ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787869089.079677:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939704960 00000100:00100000:2.0:1787869089.079683:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939704960 00000100:00100000:2.0:1787869089.079714:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787869089.079729:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:24978:x1874715939704960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787869089.079811:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:24978:x1874715939704960:12345-0@lo:502:mount.lustre.0 Request processed in 83us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869089.079818:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787869089.079927:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939704960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787869089.079964:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1787869089.079972:0:24978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1787869089.080874:0:24982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787869089.080882:0:24982:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1787869089.080889:0:24982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787869089.080891:0:24982:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787869089.080897:0:24982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787869089.080911:0:24982:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93da86efb490) 00000020:00000080:2.0:1787869089.080936:0:24982:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787869089.080940:0:24982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787869089.081016:0:24982:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d987ee3000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787869089.081025:0:24982:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787869089.081032:0:24982:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2f11f4d3bde2ee30 00010000:00010000:2.0:1787869089.086149:0:24982:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1787869089.086870:0:24982:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1787869089.088602:0:24982:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1787869089.090106:0:24982:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787869089.090118:0:24982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787869089.090124:0:24982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787869089.090127:0:24982:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787869089.090130:0:24982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787869089.090134:0:24982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787869089.090135:0:24982:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787869089.090138:0:24982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787869089.090140:0:24982:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787869089.090143:0:24982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787869089.090145:0:24982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787869089.090146:0:24982:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787869089.092635:0:24982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787869089.092658:0:24982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787869089.092660:0:24982:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787869089.092672:0:24982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787869089.092709:0:24982:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787869089.092713:0:24982:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787869089.092714:0:24982:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787869089.092718:0:24982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1787869089.094402:0:24978:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787869089.094448:0:24978:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787869089.094478:0:24978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2ee1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee22 expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.094493:0:24978:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a400/0x2f11f4d3bde2ee1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee22 expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869089.094611:0:24978:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d987ee3000 from 1 10000000:01000000:1.0:1787869089.094615:0:24978:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787869089.094656:0:24978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.094665:0:24978:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.094676:0:24978:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869089.094702:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787869089.094771:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869089.094806:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da83d7ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787869089.094872:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939705088 00000100:00100000:2.0:1787869089.094878:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939705088 00000100:00100000:2.0:1787869089.094932:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787869089.094941:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:24978:x1874715939705088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787869089.094955:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869089.094967:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab52a4000/0x2f11f4d3bde2ee3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ee37 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869089.094988:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab52a4000/0x2f11f4d3bde2ee3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ee37 expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869089.094999:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab52a4000/0x2f11f4d3bde2ee3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ee37 expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869089.095008:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a4000, rc 0) 00000100:00100000:2.0:1787869089.095049:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:24978:x1874715939705088:12345-0@lo:101:mount.lustre.0 Request processed in 109us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869089.095067:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787869089.095895:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787869089.095914:0:24978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee3e expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.095924:0:24978:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ee3e expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787869089.098998:0:24978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1787869089.099424:0:24978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787869089.100330:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1787869089.100362:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1787869089.100377:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1787869089.100392:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1787869089.100407:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1787869089.100419:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1787869089.100431:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1787869089.100441:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1787869089.100455:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1787869089.100469:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1787869089.100483:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1787869089.100503:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1787869089.100523:0:24978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1787869089.100877:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787869089.100945:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869089.102067:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da83d7ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787869089.102917:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939705216 00000100:00100000:2.0:1787869089.102926:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939705216 00000100:00100000:2.0:1787869089.103009:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787869089.103020:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:24978:x1874715939705216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787869089.103224:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:24978:x1874715939705216:12345-0@lo:501:mount.lustre.0 Request processed in 205us (2278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869089.103242:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787869089.103342:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787869089.103388:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705344:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787869089.103432:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869089.103803:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da83d7ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787869089.103865:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939705344 00000100:00100000:0.0:1787869089.103871:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939705344 00000100:00100000:0.0:1787869089.103898:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787869089.103905:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:24978:x1874715939705344:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787869089.104003:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:24978:x1874715939705344:12345-0@lo:503:mount.lustre.0 Request processed in 97us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869089.104010:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787869089.104089:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705344:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787869089.104493:0:24978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787869089.104581:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869089.104620:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869089.104638:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da83d7ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787869089.104866:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939705472 00000100:00100000:0.0:1787869089.104871:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939705472 00000100:00100000:0.0:1787869089.104892:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787869089.104899:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:24978:x1874715939705472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787869089.104983:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:24978:x1874715939705472:12345-0@lo:502:mount.lustre.0 Request processed in 85us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869089.104989:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787869089.105070:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787869089.105344:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787869089.105392:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1787869089.105409:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1787869089.105422:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1787869089.105435:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1787869089.105446:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1787869089.105459:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1787869089.105470:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1787869089.108967:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1787869089.108991:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1787869089.109005:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1787869089.109069:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705600:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787869089.109344:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869089.109390:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da83d7ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787869089.109442:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939705600 00000100:00100000:2.0:1787869089.109448:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939705600 00000100:00100000:2.0:1787869089.109502:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787869089.109523:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:24978:x1874715939705600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787869089.109804:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:24978:x1874715939705600:12345-0@lo:502:mount.lustre.0 Request processed in 283us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869089.109813:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787869089.109897:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882421c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787869089.109950:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1787869089.109960:0:24978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787869089.111407:0:24986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869089.111423:0:24986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869089.111426:0:24986:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787869089.111433:0:24986:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d987ee3000 00000020:00000080:3.0:1787869089.111436:0:24986:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787869089.111445:0:24986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869089.111448:0:24986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869089.111449:0:24986:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787869089.111451:0:24986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869089.111453:0:24986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869089.111454:0:24986:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787869089.111457:0:24986:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d987ee3000 00000020:00000080:3.0:1787869089.111458:0:24986:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787869089.111682:0:24986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869089.111687:0:24986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869089.111688:0:24986:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787869089.111691:0:24986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869089.111694:0:24986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869089.111696:0:24986:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787869089.111699:0:24986:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d987ee3000 00000020:00000080:3.0:1787869089.111702:0:24986:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787869089.113374:0:24986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869089.113386:0:24986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869089.113388:0:24986:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787869089.113392:0:24986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787869089.113396:0:24986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869089.113397:0:24986:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787869089.113401:0:24986:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d987ee3000 00000020:00000080:3.0:1787869089.113403:0:24986:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787869089.113467:0:24986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787869089.113471:0:24986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787869089.113472:0:24986:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787869089.113476:0:24986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1787869089.119668:0:24978:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787869089.119718:0:24978:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787869089.120063:0:24978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee3e expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.120077:0:24978:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee3e expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787869089.120362:0:24978:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787869089.120367:0:24978:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d987ee3000 10000000:01000000:0.0:1787869089.120370:0:24978:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d987ee3000 10000000:01000000:0.0:1787869089.120374:0:24978:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787869089.120387:0:24978:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d987ee3000 from 1 10000000:01000000:0.0:1787869089.120390:0:24978:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787869089.120430:0:24978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c000/0x2f11f4d3bde2ee45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.120438:0:24978:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93daace1c000/0x2f11f4d3bde2ee45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.120448:0:24978:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93daace1c000/0x2f11f4d3bde2ee45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869089.120472:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787869089.120546:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.122421:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99ebbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787869089.125607:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939705728 00000100:00100000:3.0:1787869089.125623:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939705728 00000100:00100000:3.0:1787869089.125763:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787869089.125774:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:24978:x1874715939705728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787869089.125793:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869089.125812:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6fb1800/0x2f11f4d3bde2ee4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ee45 expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869089.125842:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6fb1800/0x2f11f4d3bde2ee4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ee45 expref: 24 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869089.125854:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6fb1800/0x2f11f4d3bde2ee4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ee45 expref: 24 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869089.125863:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1800, rc 0) 00000100:00100000:3.0:1787869089.125936:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:24978:x1874715939705728:12345-0@lo:101:mount.lustre.0 Request processed in 165us (5390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869089.125943:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787869089.129122:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787869089.129175:0:24978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93daace1c000/0x2f11f4d3bde2ee45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee4c expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.129189:0:24978:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93daace1c000/0x2f11f4d3bde2ee45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ee4c expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787869089.130625:0:24978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1787869089.130903:0:24978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787869089.131113:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787869089.131134:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1787869089.131145:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1787869089.132281:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1787869089.132310:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1787869089.132322:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1787869089.132335:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1787869089.132354:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1787869089.132365:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1787869089.132377:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1787869089.132388:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1787869089.132399:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1787869089.132425:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1787869089.132438:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1787869089.132449:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1787869089.132460:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1787869089.132473:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1787869089.132484:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1787869089.132495:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1787869089.132521:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1787869089.132538:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1787869089.132549:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1787869089.132561:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1787869089.132574:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1787869089.132586:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1787869089.132600:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1787869089.132613:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1787869089.132626:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1787869089.132652:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1787869089.132668:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1787869089.132679:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1787869089.132689:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1787869089.132701:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1787869089.132712:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1787869089.132725:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1787869089.132737:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1787869089.132750:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1787869089.132762:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1787869089.132775:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1787869089.132789:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1787869089.132812:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1787869089.132824:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1787869089.132836:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1787869089.132847:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1787869089.132871:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1787869089.132883:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1787869089.132895:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1787869089.132907:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1787869089.133070:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1787869089.133090:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1787869089.133109:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1787869089.133115:0:24978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1787869089.133252:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787869089.133325:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.133372:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99ebb240 going to sleep for 11 seconds 00000100:00100000:3.0:1787869089.133650:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939705856 00000100:00100000:3.0:1787869089.133658:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939705856 00000100:00100000:3.0:1787869089.133714:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787869089.133723:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:24978:x1874715939705856:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787869089.133851:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:24978:x1874715939705856:12345-0@lo:501:mount.lustre.0 Request processed in 128us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869089.133859:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787869089.133959:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787869089.133993:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705984:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787869089.134035:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.134069:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99ebb240 going to sleep for 11 seconds 00000100:00100000:3.0:1787869089.134112:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939705984 00000100:00100000:3.0:1787869089.134116:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939705984 00000100:00100000:3.0:1787869089.134147:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787869089.134181:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:24978:x1874715939705984:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787869089.134256:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:24978:x1874715939705984:12345-0@lo:503:mount.lustre.0 Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869089.134262:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787869089.134394:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939705984:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787869089.134839:0:24978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787869089.134900:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939706112:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787869089.134940:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.135001:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99ebbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787869089.135066:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939706112 00000100:00100000:3.0:1787869089.135071:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939706112 00000100:00100000:3.0:1787869089.135133:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787869089.135141:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:24978:x1874715939706112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787869089.135252:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:24978:x1874715939706112:12345-0@lo:502:mount.lustre.0 Request processed in 112us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869089.135259:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787869089.135398:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939706112:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787869089.135576:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1787869089.135602:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1787869089.135625:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1787869089.135639:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1787869089.135654:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1787869089.135666:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1787869089.135690:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1787869089.135702:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1787869089.135714:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1787869089.135726:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1787869089.135739:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1787869089.135753:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1787869089.135766:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1787869089.135780:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1787869089.135793:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1787869089.135807:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1787869089.135821:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1787869089.135833:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1787869089.135844:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1787869089.135856:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1787869089.135869:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1787869089.135881:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1787869089.135926:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1787869089.135944:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1787869089.135958:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1787869089.135974:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1787869089.135989:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1787869089.136004:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1787869089.136018:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1787869089.136032:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1787869089.136046:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1787869089.136074:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1787869089.136090:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1787869089.136104:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1787869089.136119:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1787869089.136143:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1787869089.136194:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1787869089.136210:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1787869089.136237:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1787869089.136253:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1787869089.136267:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1787869089.136282:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1787869089.136296:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1787869089.136310:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1787869089.136324:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1787869089.136338:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1787869089.136352:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1787869089.136366:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1787869089.136410:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939706240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787869089.136468:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.136509:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939706240 00000100:00100000:0.0:1787869089.136515:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939706240 00000100:00100000:0.0:1787869089.136548:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787869089.136555:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:24978:x1874715939706240:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787869089.136647:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:24978:x1874715939706240:12345-0@lo:502:mount.lustre.0 Request processed in 93us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869089.136654:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787869089.136707:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99ebbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787869089.136724:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939706240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787869089.136861:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1787869089.136882:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1787869089.136901:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939706368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787869089.136933:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.136963:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939706368 00000100:00100000:0.0:1787869089.136967:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939706368 00000100:00100000:0.0:1787869089.136986:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787869089.136991:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:24978:x1874715939706368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787869089.137048:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:24978:x1874715939706368:12345-0@lo:502:mount.lustre.0 Request processed in 56us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869089.137070:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787869089.137100:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da99ebbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787869089.137111:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939706368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787869089.137143:0:24978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1787869089.137150:0:24978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787869089.139501:0:24991:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787869089.139591:0:24991:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93dabda58000) 00000020:00000080:0.0:1787869089.139618:0:24991:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1787869089.139732:0:24991:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d987ee3000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787869089.139737:0:24991:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d987ee3000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787869089.139740:0:24991:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d987ee3000 3 00010000:00080000:0.0:1787869089.139768:0:24991:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d988300000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1787869089.145789:0:24991:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1787869089.146304:0:24991:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787869089.146355:0:24991:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787869089.146369:0:24991:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2f11f4d3bde2ee5a 00000100:00080000:0.0:1787869089.146381:0:24991:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787869089.146388:0:24991:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d988300000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787869089.148427:0:24991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dab6f56d00 x1874715939706496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787869089.148464:0:24991:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787869089.148599:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939706496:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787869089.148673:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869089.148745:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939706496 00000100:00100000:3.0:1787869089.148753:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939706496 00000100:00100000:3.0:1787869089.148948:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787869089.148957:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3635:x1874715939706496:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787869089.156701:0:22654:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:3.0:1787869089.156751:0:22654:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2f11f4d3bde2ee61 00000004:00100000:3.0:1787869089.156767:0:22654:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787869089.156809:0:22654:0:(import.c:65:import_set_state_nolock()) ffff93d988acc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787869089.156902:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874715939706496:12345-0@lo:38:llog_process_th.0 Request processed in 7943us (8227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869089.156924:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787869089.156989:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dab6f56d00 x1874715939706496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787869099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869089.156999:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787869089.157007:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1787869089.157014:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787869089.157019:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787869089.157021:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d988300000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787869089.157026:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6f56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3635:1874715939706496:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787869089.157359:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787869089.157370:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787869089.157373:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93d98895e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787869089.157379:0:13937:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 711 00000100:00080000:0.0:1787869089.157383:0:13937:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787869089.157387:0:13937:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d98895e800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787869089.157405:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93da93093840 x1874715939706880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787869089.157438:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787869089.157441:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787869089.157442:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93da88341000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787869089.157445:0:13937:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 711 00000100:00080000:0.0:1787869089.157447:0:13937:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787869089.157451:0:13937:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93da88341000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787869089.157462:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dabec8c780 x1874715939707392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787869089.158490:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939706624:0@lo:400:kworker.0 00000100:00100000:0.0:1787869089.158680:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.158720:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939707264:0@lo:400:kworker.0 00000100:00100000:0.0:1787869089.158745:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.158771:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787869089.158777:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939707136:0@lo:400:kworker.0 00000100:00100000:0.0:1787869089.158797:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.158810:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939707776:0@lo:400:kworker.0 00000100:00100000:0.0:1787869089.158828:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.158867:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939707776 00000100:00100000:0.0:1787869089.158874:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939707776 00000100:00100000:0.0:1787869089.158927:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787869089.158936:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939707776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869089.158982:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939707776:12345-0@lo:400:kworker.0 Request processed in 48us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869089.158988:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787869089.159026:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939707008:0@lo:400:kworker.0 00000100:00100000:0.0:1787869089.159050:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.159079:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939707648:0@lo:400:kworker.0 00000100:00100000:0.0:1787869089.159118:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.159132:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787869089.159138:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da930921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939706752:0@lo:400:kworker.0 00000100:00100000:1.0:1787869089.159347:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939706624 00000100:00100000:1.0:1787869089.159351:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939706624 00000100:00100000:1.0:1787869089.159374:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939707136 00000100:00100000:1.0:1787869089.159376:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939707136 00000100:00100000:1.0:1787869089.159388:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787869089.159394:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939706624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869089.159999:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939706624:12345-0@lo:400:kworker.0 Request processed in 602us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869089.160007:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787869089.160031:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787869089.160038:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939707136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869089.160084:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939707136:12345-0@lo:400:kworker.0 Request processed in 48us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869089.160090:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787869089.160329:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939707008 00000100:00100000:1.0:1787869089.160335:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939707008 00000100:00100000:1.0:1787869089.160387:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939707648 00000100:00100000:1.0:1787869089.160389:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939707648 00000100:00100000:1.0:1787869089.160408:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787869089.160414:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939707008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869089.160447:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874715939707008:12345-0@lo:400:kworker.0 Request processed in 34us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869089.160452:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787869089.160462:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787869089.160468:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939707648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869089.160493:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874715939707648:12345-0@lo:400:kworker.0 Request processed in 26us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869089.160498:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787869089.160528:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939707264 00000100:00100000:1.0:1787869089.160532:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939707264 00000100:00100000:1.0:1787869089.160571:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787869089.160578:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939707264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869089.160618:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939707264:12345-0@lo:400:kworker.0 Request processed in 41us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869089.160625:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787869089.160656:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93093840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939706880:0@lo:8:kworker.0 00000100:00100000:0.0:1787869089.161082:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.161128:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939707520:0@lo:400:kworker.0 00000100:00100000:1.0:1787869089.161261:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869089.161284:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939707392:0@lo:8:kworker.0 00000100:00100000:1.0:1787869089.161311:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869089.161342:0:24160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939706752 00000100:00100000:1.0:1787869089.161345:0:24160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939706752 00000100:00100000:1.0:1787869089.161369:0:24160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939706880 00000100:00100000:1.0:1787869089.161372:0:24160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939706880 00000100:00100000:1.0:1787869089.161383:0:24160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939707392 00000100:00100000:1.0:1787869089.161386:0:24160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939707392 00000100:00100000:1.0:1787869089.161396:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787869089.161403:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939706752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869089.161436:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939706752:12345-0@lo:400:kworker.0 Request processed in 34us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869089.161441:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787869089.161452:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787869089.161456:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939706880:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787869089.161515:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939706880:12345-0@lo:8:kworker.0 Request processed in 45us (251us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787869089.161520:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787869089.161531:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787869089.161535:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939707392:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787869089.161795:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939707392:12345-0@lo:8:kworker.0 Request processed in 257us (482us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787869089.161811:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787869089.161848:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787869089.161855:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d98895e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787869089.161859:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787869089.161863:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93093840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939706880:0@lo:8:kworker.0 00000100:00100000:1.0:1787869089.161870:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787869089.161873:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da88341000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787869089.161875:0:3635:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787869089.161878:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939707392:0@lo:8:kworker.0 00000100:00100000:0.0:1787869089.161958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787869089.161986:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93da93093480 x1874715939707008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869089.161997:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874715939707008:0@lo:400:kworker.0 00010000:00080000:0.0:1787869089.162007:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dabec8c3c0 x1874715939707648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869089.162016:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3637:1874715939707648:0@lo:400:kworker.0 00000100:00100000:0.0:1787869089.162033:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da930921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939706752:0@lo:400:kworker.0 00000100:00080000:0.0:1787869089.162050:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787869089.162070:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787869089.162072:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787869089.162095:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939707136:0@lo:400:kworker.0 00010000:00080000:0.0:1787869089.162107:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dabec8de00 x1874715939707776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869089.162116:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939707776:0@lo:400:kworker.0 00000100:00100000:0.0:1787869089.162126:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939706624:0@lo:400:kworker.0 00000100:00100000:0.0:1787869089.162136:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939707264:0@lo:400:kworker.0 00000100:00100000:0.0:1787869089.162239:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939707520 00000100:00100000:0.0:1787869089.162244:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939707520 00000100:00100000:0.0:1787869089.162379:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787869089.162385:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939707520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869089.162424:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874715939707520:12345-0@lo:400:kworker.0 Request processed in 39us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869089.162430:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787869089.162450:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dabec8e1c0 x1874715939707520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869089.162459:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874715939707520:0@lo:400:kworker.0 00000020:01000004:1.0:1787869089.162803:0:24991:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787869089.162819:0:24991:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff93dabc0b9a48) 00000020:00000080:1.0:1787869089.162838:0:24991:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1787869089.162917:0:24991:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d987ee3000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787869089.162921:0:24991:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d987ee3000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787869089.162923:0:24991:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d987ee3000 3 00010000:00080000:1.0:1787869089.162949:0:24991:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d98802e800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.127@tcp at head 00010000:00010000:0.0:1787869089.173654:0:24991:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1787869089.174718:0:24991:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787869089.174770:0:24991:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787869089.174787:0:24991:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2f11f4d3bde2ee6f 00000100:00080000:0.0:1787869089.174799:0:24991:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787869089.174806:0:24991:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93d98802e800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:0.0:1787869089.174843:0:24991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93dabec8e1c0 x1874715939707904/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787869089.174879:0:24991:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787869089.175119:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1874715939707904:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787869089.175216:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.176518:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939707904 00000100:00100000:0.0:1787869089.176528:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939707904 00000100:00100000:0.0:1787869089.176567:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787869089.176574:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1874715939707904:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787869089.176606:0:22655:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:0.0:1787869089.176638:0:22655:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2f11f4d3bde2ee76 00000004:00100000:0.0:1787869089.176653:0:22655:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787869089.176685:0:22655:0:(import.c:65:import_set_state_nolock()) ffff93d988302000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787869089.176761:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874715939707904:12345-0@lo:38:llog_process_th.0 Request processed in 186us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869089.176768:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787869089.176876:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93dabec8e1c0 x1874715939707904/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787869099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869089.176887:0:3635:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787869089.176895:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1787869089.176901:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787869089.176906:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787869089.176908:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d98802e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787869089.176914:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3635:1874715939707904:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787869089.181608:0:24991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1787869089.181980:0:24978:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787869089.182013:0:24978:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787869089.182036:0:24978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93daace1c000/0x2f11f4d3bde2ee45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee4c expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869089.182072:0:24978:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93daace1c000/0x2f11f4d3bde2ee45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee4c expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787869089.182116:0:24978:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787869089.182118:0:24978:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787869089.182119:0:24978:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787869089.182121:0:24978:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787869089.182122:0:24978:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787869089.182123:0:24978:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787869089.182125:0:24978:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787869089.182127:0:24978:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787869089.182128:0:24978:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787869089.182131:0:24978:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787869089.182133:0:24978:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787869089.182134:0:24978:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787869089.182135:0:24978:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787869089.182136:0:24978:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787869089.182137:0:24978:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787869089.182138:0:24978:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787869089.182139:0:24978:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787869089.182140:0:24978:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787869089.182141:0:24978:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787869089.182250:0:24978:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787869089.182279:0:24978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939708032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787869089.182345:0:24978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869089.182383:0:24978:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c6600 going to sleep for 11 seconds 00000100:00100000:0.0:1787869089.182731:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939708032 00000100:00100000:0.0:1787869089.182740:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939708032 00000100:00100000:0.0:1787869089.182824:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787869089.182834:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:24978:x1874715939708032:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787869089.182860:0:22649:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787869089.182874:0:22649:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787869089.193100:0:22649:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787869089.193181:0:22649:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787869089.193858:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:24978:x1874715939708032:12345-0@lo:253:mount.lustre.0 Request processed in 11021us (11506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869089.193872:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787869089.193978:0:24978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a462b6e-823a-4baf-a873-a4eb993ef5c7:24978:1874715939708032:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787869089.193993:0:24978:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787869089.193996:0:24978:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787869089.193998:0:24978:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787869089.193999:0:24978:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787869089.194001:0:24978:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787869089.194002:0:24978:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787869089.194003:0:24978:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787869089.194005:0:24978:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787869089.194007:0:24978:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787869089.194008:0:24978:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787869089.194024:0:24978:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787869089.195176:0:22670:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787869089.195183:0:22670:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787869089.195204:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869089.195221:0:22670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93daace1ca00/0x2f11f4d3bde2ed11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ed0a expref: 23 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869089.195240:0:22670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ed1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ed18 expref: 23 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869089.195247:0:22670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869089.195468:0:22670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ed1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ed18 expref: 23 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869089.195481:0:22670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ed1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ed18 expref: 23 pid: 22648 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869089.195494:0:22670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22670:1874715939708160:0@lo:104: 00000100:00100000:3.0:1787869089.195621:0:22670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787869089.195671:0:22670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93daace1ca00/0x2f11f4d3bde2ed11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ed0a expref: 23 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869089.195679:0:22670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93daace1ca00/0x2f11f4d3bde2ed11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ed0a expref: 23 pid: 22648 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869089.195688:0:22670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22670:1874715939708288:0@lo:104: 00000100:00100000:3.0:1787869089.195707:0:22670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869089.195729:0:22670:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc0c69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787869089.195799:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939708160 00000100:00100000:1.0:1787869089.195811:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939708160 00000100:00100000:1.0:1787869089.195841:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939708288 00000100:00100000:1.0:1787869089.195843:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939708288 00000100:00100000:1.0:1787869089.195856:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787869089.195864:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+4:22670:x1874715939708160:12345-0@lo:104: 00010000:00010000:1.0:1787869089.195875:0:22638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ed1f expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.195931:0:22638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787869089.195937:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+4:22670:x1874715939708160:12345-0@lo:104: Request processed in 74us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869089.195943:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787869089.195959:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787869089.195965:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+3:22670:x1874715939708288:12345-0@lo:104: 00010000:00010000:1.0:1787869089.195972:0:22638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ed11 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.196003:0:22638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787869089.196008:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+3:22670:x1874715939708288:12345-0@lo:104: Request processed in 44us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869089.196014:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787869089.196030:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787869089.196036:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ed1f expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.196043:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1cc00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787869089.196047:0:22643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ed1f expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.196078:0:22643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ed1f expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787869089.196085:0:22643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ed1f expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869089.196091:0:22643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787869089.196119:0:22643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ed1f expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.196125:0:22643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787869089.196141:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ed1f expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.196185:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93daace1cc00/0x2f11f4d3bde2ed18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ed1f expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.196197:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869089.196201:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ed11 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.196206:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1de00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787869089.196209:0:22643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ed11 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.196215:0:22643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ed11 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787869089.196221:0:22643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ed11 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869089.196232:0:22643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787869089.196246:0:22643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ed11 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.196252:0:22643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787869089.196385:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ed11 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.196392:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93daace1de00/0x2f11f4d3bde2ed0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ed11 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.196407:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869089.196409:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869089.196410:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787869089.196429:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939708544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787869089.196460:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869089.196492:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939708544 00000100:00100000:1.0:1787869089.196495:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939708544 00010000:00010000:1.0:1787869089.196590:0:22641:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93daace1ca00/0x2f11f4d3bde2ed11 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ed0a expref: 24 pid: 22648 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869089.196612:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787869089.196619:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:3636:x1874715939708544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787869089.196629:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787869089.196635:0:22641:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93daace1ca00/0x2f11f4d3bde2ed11 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ed0a expref: 24 pid: 22648 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.196645:0:22641:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93daace1ca00/0x2f11f4d3bde2ed11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ed0a expref: 24 pid: 22648 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869089.196667:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787869089.196696:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:3636:x1874715939708544:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869089.196703:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787869089.196735:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939708544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787869089.196803:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787869089.196825:0:22670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393cf00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22670:1874715939708160:0@lo:104: 00010000:00010000:3.0:1787869089.196834:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93daace1ca00/0x2f11f4d3bde2ed11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ed0a expref: 23 pid: 22648 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869089.196843:0:22670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393f840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22670:1874715939708288:0@lo:104: 00010000:00010000:3.0:1787869089.196871:0:22670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869089.197190:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939708416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787869089.197223:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869089.197397:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939708416 00000100:00100000:0.0:1787869089.197402:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939708416 00010000:00010000:0.0:1787869089.197424:0:22639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ed1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ed18 expref: 23 pid: 22648 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869089.197447:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787869089.197454:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:3639:x1874715939708416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787869089.197464:0:22639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787869089.197468:0:22639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ed1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ed18 expref: 23 pid: 22648 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.197478:0:22639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ed1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ed18 expref: 23 pid: 22648 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.197490:0:22639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dabd870800/0x2f11f4d3bde2ed1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ed18 expref: 23 pid: 22648 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.197502:0:22639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.197578:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787869089.197593:0:22639:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003106206s 00010000:00010000:0.0:1787869089.197598:0:22639:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.197604:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.197612:0:22639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.197625:0:22639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.197631:0:22639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787869089.197634:0:22639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.197642:0:22639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.197658:0:22639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.197668:0:22639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787869089.197698:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:3639:x1874715939708416:12345-0@lo:103:ldlm_bl.0 Request processed in 245us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869089.197706:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787869089.197734:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939708416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787869089.197751:0:22670:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.197758:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869089.197765:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2ee7d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1787869089.199737:0:24978:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1787869089.203048:0:24978:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787869089.203069:0:24978:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787869089.203112:0:24978:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787869089.203644:0:24978:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787869089.203667:0:24978:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787869089.203703:0:24978:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787869089.207937:0:24978:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787869089.208226:0:24978:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1787869089.441974:0:23410:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787869089.635084:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787869090.232122:0:25044:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787869090.232647:0:25044:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1787869090.595885:0:22651:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787869090.595894:0:22651:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93da88303000 from 14 10000000:01000000:2.0:1787869090.595899:0:22651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787869090.595951:0:22651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab52a4e00/0x2f11f4d3bde2ee84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869090.595963:0:22651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab52a4e00/0x2f11f4d3bde2ee84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869090.595975:0:22651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab52a4e00/0x2f11f4d3bde2ee84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869090.596003:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939708672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787869090.596087:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869090.596136:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7ef240 going to sleep for 11 seconds 00000100:00100000:3.0:1787869090.598823:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939708672 00000100:00100000:3.0:1787869090.598843:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939708672 00000100:00100000:3.0:1787869090.598951:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787869090.598966:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:22651:x1874715939708672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787869090.598988:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869090.599013:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6fb1e00/0x2f11f4d3bde2ee8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ee84 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869090.599063:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6fb1e00/0x2f11f4d3bde2ee8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ee84 expref: 23 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869090.599079:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6fb1e00/0x2f11f4d3bde2ee8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ee84 expref: 23 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869090.599089:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1e00, rc 0) 00000100:00100000:3.0:1787869090.599306:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:22651:x1874715939708672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 345us (3219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869090.599314:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787869090.600101:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939708672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787869090.600126:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab52a4e00/0x2f11f4d3bde2ee84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee8b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869090.600137:0:22651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab52a4e00/0x2f11f4d3bde2ee84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ee8b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869090.600250:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939708800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787869090.600299:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869090.600327:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7ef240 going to sleep for 11 seconds 00000100:00100000:0.0:1787869090.600517:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939708800 00000100:00100000:0.0:1787869090.600524:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939708800 00000100:00100000:0.0:1787869090.600569:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787869090.600686:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:22651:x1874715939708800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787869090.600710:0:22649:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787869090.600729:0:22649:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787869090.600732:0:22649:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1787869090.601103:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:22651:x1874715939708800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 525us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869090.601112:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787869090.601676:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939708800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787869090.601751:0:22651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787869090.601760:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab52a4e00/0x2f11f4d3bde2ee84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee8b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869090.601770:0:22651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab52a4e00/0x2f11f4d3bde2ee84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee8b expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787869090.601858:0:22651:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787869090.601861:0:22651:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93dab523f000 from 14 10000000:01000000:2.0:1787869090.601863:0:22651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787869090.601892:0:22651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab52a5600/0x2f11f4d3bde2ee92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869090.601900:0:22651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab52a5600/0x2f11f4d3bde2ee92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869090.601909:0:22651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab52a5600/0x2f11f4d3bde2ee92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869090.601926:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939708928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787869090.601963:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869090.602000:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7ef240 going to sleep for 11 seconds 00000100:00100000:3.0:1787869090.602337:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939708928 00000100:00100000:3.0:1787869090.602344:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939708928 00000100:00100000:3.0:1787869090.602381:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787869090.602390:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:22651:x1874715939708928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787869090.602402:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869090.602416:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6fb1400/0x2f11f4d3bde2ee99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2ee92 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869090.602454:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6fb1400/0x2f11f4d3bde2ee99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ee92 expref: 24 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869090.602465:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6fb1400/0x2f11f4d3bde2ee99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ee92 expref: 24 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869090.602474:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1400, rc 0) 00000100:00100000:3.0:1787869090.602511:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:22651:x1874715939708928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869090.602517:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787869090.602888:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939708928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787869090.602910:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab52a5600/0x2f11f4d3bde2ee92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee99 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869090.602919:0:22651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab52a5600/0x2f11f4d3bde2ee92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2ee99 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869090.602968:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939709056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787869090.603004:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869090.603040:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7ef240 going to sleep for 11 seconds 00000100:00100000:0.0:1787869090.603219:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939709056 00000100:00100000:0.0:1787869090.603224:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939709056 00000100:00100000:0.0:1787869090.603260:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787869090.603269:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:22651:x1874715939709056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787869090.603284:0:22649:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787869090.603299:0:22649:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787869090.603302:0:22649:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1787869090.603394:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:22651:x1874715939709056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869090.603402:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787869090.605789:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabed0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939709056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787869090.605884:0:22651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787869090.605895:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab52a5600/0x2f11f4d3bde2ee92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee99 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869090.605907:0:22651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab52a5600/0x2f11f4d3bde2ee92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2ee99 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869090.657471:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869091.681286:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869092.705439:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787869093.153355:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939709184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787869093.153433:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869093.153533:0:24163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939709184 00000100:00100000:0.0:1787869093.153540:0:24163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939709184 00000100:00100000:0.0:1787869093.153605:0:24163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787869093.153616:0:24163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939709184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787869093.153672:0:24163:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787869093.153718:0:24163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939709184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869093.153726:0:24163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787869093.153883:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787869093.153934:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939709184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787869093.159937:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787869093.159962:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939709312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787869093.160047:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869093.160321:0:24163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939709312 00000100:00100000:0.0:1787869093.160328:0:24163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939709312 00000100:00100000:0.0:1787869093.160388:0:24163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787869093.160398:0:24163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939709312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787869093.160419:0:24163:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787869093.160462:0:24163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939709312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869093.160469:0:24163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787869093.160488:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787869093.160518:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939709312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787869093.666920:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988242d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939709440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787869093.667007:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869093.667061:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939709568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787869093.667104:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869093.667152:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939709440 00000100:00100000:0.0:1787869093.667174:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939709440 00000100:00100000:0.0:1787869093.667212:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939709568 00000100:00100000:0.0:1787869093.667215:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939709568 00000100:00100000:0.0:1787869093.667234:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787869093.667243:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939709440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787869093.667278:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787869093.667335:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939709440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869093.667351:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787869093.667370:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787869093.667376:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939709568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787869093.667394:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787869093.667636:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988242d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939709440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787869093.669934:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939709568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2552us (2823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869093.669947:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787869093.670039:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939709568:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787869093.732179:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787869094.114922:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1787869094.177713:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869094.177721:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787869094.177725:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93d98895e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787869094.177738:0:13937:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d98895e800 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787869094.177761:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988241a40 x1874715939710080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787869094.177802:0:13937:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787869094.177806:0:13937:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787869094.177815:0:13937:0:(import.c:65:import_set_state_nolock()) ffff93da88341000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787869094.177822:0:13937:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93da88341000 using connection 192.168.204.127@tcp/0@lo 00000100:00100000:1.0:1787869094.177837:0:13937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d988240b40 x1874715939710592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787869094.177913:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988243c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939710208:0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.177996:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.178034:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939710848:0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178061:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.178090:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787869094.178106:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988242d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939709696:0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178140:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.178192:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939710336:0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178216:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.178233:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939710976:0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178254:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.178279:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939709824:0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178302:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.178319:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988242940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939710464:0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178343:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.178359:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da93090780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939711104:0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178378:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.178388:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787869094.178393:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988241680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939709952:0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178408:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.178429:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939710720:0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178447:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.178456:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939711232:0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178473:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.178493:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988241a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939710080:0@lo:8:kworker.0 00000100:00100000:1.0:1787869094.178515:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.178531:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939710592:0@lo:8:kworker.0 00000100:00100000:1.0:1787869094.178549:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.178576:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939710208 00000100:00100000:1.0:1787869094.178583:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939710208 00000100:00100000:1.0:1787869094.178621:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939710848 00000100:00100000:1.0:1787869094.178624:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939710848 00000100:00100000:1.0:1787869094.178648:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939710976 00000100:00100000:1.0:1787869094.178650:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939710976 00000100:00100000:1.0:1787869094.178663:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939711104 00000100:00100000:1.0:1787869094.178666:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939711104 00000100:00100000:1.0:1787869094.178676:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939710720 00000100:00100000:1.0:1787869094.178679:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939710720 00000100:00100000:1.0:1787869094.178688:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939711232 00000100:00100000:1.0:1787869094.178691:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939711232 00000100:00100000:1.0:1787869094.178704:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787869094.178711:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da930921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939710208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178757:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da930921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874715939710208:12345-0@lo:400:kworker.0 Request processed in 46us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869094.178764:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787869094.178780:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787869094.178785:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939710848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178808:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874715939710848:12345-0@lo:400:kworker.0 Request processed in 23us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869094.178821:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787869094.178834:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787869094.178840:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da933683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939710976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178872:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da933683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939710976:12345-0@lo:400:kworker.0 Request processed in 33us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869094.178877:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787869094.178887:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787869094.178892:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939711104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178919:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874715939711104:12345-0@lo:400:kworker.0 Request processed in 28us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869094.178924:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787869094.178933:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787869094.178938:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939710720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.178979:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939710720:12345-0@lo:400:kworker.0 Request processed in 40us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869094.178984:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787869094.178995:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787869094.179000:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939711232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.179023:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939711232:12345-0@lo:400:kworker.0 Request processed in 24us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869094.179029:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787869094.179051:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939709696 00000100:00100000:1.0:1787869094.179054:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939709696 00000100:00100000:1.0:1787869094.179082:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787869094.179088:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:3636:x1874715939709696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.179136:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:3636:x1874715939709696:12345-0@lo:400:kworker.0 Request processed in 48us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869094.179143:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787869094.179196:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939710336 00000100:00100000:1.0:1787869094.179201:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939710336 00000100:00100000:1.0:1787869094.179219:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939709824 00000100:00100000:1.0:1787869094.179222:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939709824 00000100:00100000:1.0:1787869094.179233:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787869094.179238:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93093840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939710336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.179268:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93093840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939710336:12345-0@lo:400:kworker.0 Request processed in 30us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869094.179274:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787869094.179285:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787869094.179291:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939709824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.179316:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939709824:12345-0@lo:400:kworker.0 Request processed in 25us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869094.179321:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787869094.179345:0:24160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939710464 00000100:00100000:1.0:1787869094.179349:0:24160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939710464 00000100:00100000:1.0:1787869094.179372:0:24160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939709952 00000100:00100000:1.0:1787869094.179375:0:24160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939709952 00000100:00100000:1.0:1787869094.179387:0:24160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939710080 00000100:00100000:1.0:1787869094.179390:0:24160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939710080 00000100:00100000:1.0:1787869094.179398:0:24160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939710592 00000100:00100000:1.0:1787869094.179400:0:24160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939710592 00000100:00100000:1.0:1787869094.179407:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787869094.179413:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9336a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939710464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.179442:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9336a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939710464:12345-0@lo:400:kworker.0 Request processed in 29us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869094.179455:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787869094.179466:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787869094.179471:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93368f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939709952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869094.179497:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93368f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939709952:12345-0@lo:400:kworker.0 Request processed in 26us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869094.179502:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787869094.179512:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787869094.179515:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939710080:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787869094.179541:0:24160:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:1.0:1787869094.179567:0:24160:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2f11f4d3bde2eea0 00002000:00100000:1.0:1787869094.179581:0:24160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93d988028000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113963 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787869094.179585:0:24160:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787869094.179588:0:24160:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787869094.179770:0:24160:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787869094.179795:0:24160:0:(import.c:65:import_set_state_nolock()) ffff93d98802f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787869094.179830:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1874715939710080:12345-0@lo:8:kworker.0 Request processed in 313us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869094.179837:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787869094.179848:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787869094.179852:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3635:x1874715939710592:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787869094.179865:0:24160:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:1.0:1787869094.179880:0:24160:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2f11f4d3bde2eea7 00002000:00100000:1.0:1787869094.179885:0:24160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff93d98802b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113963 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1787869094.179888:0:24160:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1787869094.179895:0:24160:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787869094.179915:0:24160:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1787869094.179927:0:24160:0:(import.c:65:import_set_state_nolock()) ffff93d98802b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787869094.179950:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1874715939710592:12345-0@lo:8:kworker.0 Request processed in 97us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869094.179969:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787869094.179997:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787869094.180000:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787869094.180034:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988241a40 x1874715939710080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787869119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787869094.180050:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787869094.180057:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787869094.180061:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787869094.180064:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93d98895e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787869094.180075:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787869094.180080:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988241a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3635:1874715939710080:0@lo:8:kworker.0 00010000:00080000:1.0:1787869094.180093:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988240b40 x1874715939710592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787869119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787869094.180101:0:3635:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1787869094.180105:0:3635:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787869094.180109:0:3635:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787869094.180111:0:3635:0:(import.c:65:import_set_state_nolock()) ffff93da88341000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787869094.180122:0:3635:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787869094.180125:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3635:1874715939710592:0@lo:8:kworker.0 00000004:00080000:1.0:1787869094.180191:0:22681:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1787869094.180206:0:22681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22681:1874715939711488:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787869094.180244:0:22681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.180263:0:22681:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d981e033c0 going to sleep for 11 seconds 00000004:00080000:1.0:1787869094.180286:0:23398:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787869094.180298:0:23398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23398:1874715939711744:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1787869094.180319:0:23398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.180333:0:23398:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d981e03a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787869094.180345:0:24907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939711488 00000100:00100000:1.0:1787869094.180349:0:24907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939711488 00000100:00100000:1.0:1787869094.180373:0:24907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939711744 00000100:00100000:1.0:1787869094.180375:0:24907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939711744 00000100:00100000:1.0:1787869094.180389:0:24907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787869094.180394:0:24907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22681:x1874715939711488:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787869094.180540:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939711616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787869094.180569:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869094.180595:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787869094.180600:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939711360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787869094.180617:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787869094.180639:0:22680:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787869094.180703:0:22680:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718306546116ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787869094.180709:0:22680:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787869094.180732:0:23397:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787869094.180766:0:23397:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 718306609615ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787869094.180770:0:23397:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787869094.180938:0:24161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787869094.180946:0:24161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23398:x1874715939711744:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1787869094.180986:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787869094.181010:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988241680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939709952:0@lo:400:kworker.0 00010000:00080000:2.0:1787869094.181022:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988240f00 x1874715939710720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869094.181032:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939710720:0@lo:400:kworker.0 00010000:00080000:2.0:1787869094.181044:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da930930c0 x1874715939711232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869094.181053:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da930930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939711232:0@lo:400:kworker.0 00000100:00100000:2.0:1787869094.181062:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939709824:0@lo:400:kworker.0 00000100:00100000:2.0:1787869094.181072:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988242940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939710464:0@lo:400:kworker.0 00010000:00080000:2.0:1787869094.181084:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da93090780 x1874715939711104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869094.181092:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93090780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3638:1874715939711104:0@lo:400:kworker.0 00000100:00100000:2.0:1787869094.181124:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988242d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939709696:0@lo:400:kworker.0 00000100:00100000:2.0:1787869094.181135:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939710336:0@lo:400:kworker.0 00010000:00080000:2.0:1787869094.181146:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da93093c00 x1874715939710976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869094.181177:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da93093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939710976:0@lo:400:kworker.0 00010000:00080000:2.0:1787869094.181191:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988243c00 x1874715939710208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869094.181199:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988243c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874715939710208:0@lo:400:kworker.0 00010000:00080000:2.0:1787869094.181208:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d988240000 x1874715939710848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869094.181215:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3636:1874715939710848:0@lo:400:kworker.0 00000100:00100000:2.0:1787869094.181257:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939711616 00000100:00100000:2.0:1787869094.181262:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939711616 00000100:00100000:2.0:1787869094.181280:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939711360 00000100:00100000:2.0:1787869094.181283:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939711360 00000100:00100000:2.0:1787869094.181296:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787869094.181302:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3637:x1874715939711616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787869094.181320:0:24164:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787869094.181362:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3637:x1874715939711616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869094.181370:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787869094.181382:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787869094.181388:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1874715939711360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787869094.181395:0:24164:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787869094.181417:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1874715939711360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869094.181422:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787869094.181444:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9863c1e00 x1874715939711360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787869110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869094.181464:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939711360:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787869094.181474:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d9863c0780 x1874715939711616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787869110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787869094.181484:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939711616:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1787869094.184568:0:23387:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1787869094.184649:0:22634:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1787869094.190431:0:24907:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787869094.190444:0:24907:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1787869094.190451:0:24907:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00002000:00010000:1.0:1787869094.204907:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.204921:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2eeae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.204940:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.204944:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.204951:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2eeae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.204981:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2eeae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.205006:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2eeae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.205015:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2eeae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.205037:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787869094.205050:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869094.205069:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2eeae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.205077:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ba00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869094.205082:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2eeae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.205091:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2eeae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.205107:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2eeae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.205115:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2eeae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.205131:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869094.205138:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869094.205140:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787869094.206231:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.206243:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2eeb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206258:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.206262:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.206268:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2eeb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206280:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2eeb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206289:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2eeb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206298:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2eeb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206321:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787869094.206735:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.206742:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2eebc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206750:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.206754:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.206758:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2eebc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206775:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2eebc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206783:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2eebc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206790:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2eebc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206807:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787869094.206819:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787869094.206825:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2eeb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206833:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869094.206837:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2eeb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206846:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2eeb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206862:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2eeb5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206869:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2eeb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206890:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869094.206894:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2eebc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206899:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869094.206903:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2eebc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206909:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2eebc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206917:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2eebc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206924:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2eebc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.206932:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869094.206933:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869094.206935:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.207187:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787869094.208248:0:24161:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787869094.208256:0:24161:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787869094.208363:0:24161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23398:x1874715939711744:12345-0@lo:7:osp-pre-1-1.0 Request processed in 27412us (28036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869094.208374:0:24161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787869094.208474:0:23398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23398:1874715939711744:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787869094.208494:0:23398:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787869094.208538:0:23398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23398:1874715939711872:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787869094.208705:0:23398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.208756:0:23398:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d981e03a80 going to sleep for 11 seconds 00002000:00010000:1.0:1787869094.208825:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.208838:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2eec3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.208852:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.208856:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.208866:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2eec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.208877:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2eec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.208886:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2eec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.208897:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2eec3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.208923:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787869094.208983:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869094.208991:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2eec3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.209000:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ac00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869094.209003:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2eec3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.209012:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2eec3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.209030:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2eec3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.209042:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2eec3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.209124:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.209127:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.209129:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787869094.209251:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939711872 00000100:00100000:0.0:1787869094.209258:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939711872 00000100:00100000:0.0:1787869094.209300:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787869094.209310:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23398:x1874715939711872:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787869094.209337:0:24665:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1787869094.209385:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23398:x1874715939711872:12345-0@lo:5:osp-pre-1-1.0 Request processed in 77us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869094.209392:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00002000:00010000:3.0:1787869094.209413:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869094.209419:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faae4667/0x2f11f4d3bde2eeca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.209428:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1787869094.209430:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869094.209434:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faae4667/0x2f11f4d3bde2eeca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.209443:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faae4667/0x2f11f4d3bde2eeca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.209451:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faae4667/0x2f11f4d3bde2eeca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.209458:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faae4667/0x2f11f4d3bde2eeca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869094.209542:0:23398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23398:1874715939711872:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787869094.209552:0:23398:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787869094.209578:0:23398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23398:1874715939712000:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787869094.209604:0:23398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.209631:0:23398:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d981e03a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787869094.209645:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939712000 00000100:00100000:1.0:1787869094.209656:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939712000 00000100:00100000:1.0:1787869094.209684:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787869094.209690:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23398:x1874715939712000:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787869094.209714:0:24162:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:3.0:1787869094.209864:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787869094.212523:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869094.212535:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faae4667/0x2f11f4d3bde2eeca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.212550:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787869094.212555:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faae4667/0x2f11f4d3bde2eeca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.212699:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faae4667/0x2f11f4d3bde2eeca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.212725:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faae4667/0x2f11f4d3bde2eeca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.212733:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faae4667/0x2f11f4d3bde2eeca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.212754:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.212756:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.212758:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787869094.213472:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869094.213481:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eed1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.213498:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1787869094.213503:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869094.213510:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eed1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.213528:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eed1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.213538:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eed1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.213545:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eed1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.214151:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787869094.214697:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869094.214705:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eed1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.214716:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a5200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787869094.214720:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eed1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.214730:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eed1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.214748:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eed1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.214767:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3a82ee7/0x2f11f4d3bde2eed1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.214786:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.214787:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.214789:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787869094.215046:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869094.215070:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031361a63/0x2f11f4d3bde2eed8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.215082:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1787869094.215086:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869094.215091:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031361a63/0x2f11f4d3bde2eed8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.215102:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031361a63/0x2f11f4d3bde2eed8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.215110:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031361a63/0x2f11f4d3bde2eed8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.215118:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031361a63/0x2f11f4d3bde2eed8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.215138:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787869094.215691:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869094.215698:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031361a63/0x2f11f4d3bde2eed8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.215706:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a5e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787869094.215709:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031361a63/0x2f11f4d3bde2eed8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.215717:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031361a63/0x2f11f4d3bde2eed8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.215731:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031361a63/0x2f11f4d3bde2eed8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.215739:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031361a63/0x2f11f4d3bde2eed8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.215753:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.215755:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.215756:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787869094.216903:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787869094.216911:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000754a881f/0x2f11f4d3bde2eedf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.216925:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1787869094.216928:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869094.216934:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000754a881f/0x2f11f4d3bde2eedf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.216945:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000754a881f/0x2f11f4d3bde2eedf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.216970:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000754a881f/0x2f11f4d3bde2eedf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.216978:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000754a881f/0x2f11f4d3bde2eedf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.216998:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787869094.217728:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869094.217736:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000754a881f/0x2f11f4d3bde2eedf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.217746:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a4200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787869094.217750:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000754a881f/0x2f11f4d3bde2eedf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.217758:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000754a881f/0x2f11f4d3bde2eedf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.217774:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000754a881f/0x2f11f4d3bde2eedf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.217781:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000754a881f/0x2f11f4d3bde2eedf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.217795:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.217797:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.217798:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869094.217991:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869094.218003:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000221bc5be/0x2f11f4d3bde2eee6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.218012:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1787869094.218015:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869094.218021:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000221bc5be/0x2f11f4d3bde2eee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.218030:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000221bc5be/0x2f11f4d3bde2eee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.218038:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000221bc5be/0x2f11f4d3bde2eee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.218044:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000221bc5be/0x2f11f4d3bde2eee6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.218064:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787869094.218079:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869094.218085:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000221bc5be/0x2f11f4d3bde2eee6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.218092:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787869094.218095:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000221bc5be/0x2f11f4d3bde2eee6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.218115:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000221bc5be/0x2f11f4d3bde2eee6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.218127:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000221bc5be/0x2f11f4d3bde2eee6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.218135:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221bc5be/0x2f11f4d3bde2eee6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.218148:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.218149:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.218151:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869094.221937:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869094.221950:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2eeed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.221980:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1787869094.221985:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869094.221992:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2eeed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.222007:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2eeed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.222025:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2eeed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.222033:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2eeed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.222055:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787869094.222127:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869094.222135:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2eeed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.222144:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787869094.222149:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2eeed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.222191:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2eeed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.222210:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2eeed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.222229:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2b62aa2/0x2f11f4d3bde2eeed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.222246:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.222248:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.222250:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869094.224714:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869094.224726:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2eef4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.224742:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1787869094.224747:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869094.224753:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2eef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.224766:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2eef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.224777:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2eef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.224786:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2eef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.224817:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787869094.224952:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869094.224970:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2eef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.224979:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1c00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869094.224984:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2eef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.224995:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2eef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.225013:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2eef4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.225021:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2eef4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.225038:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.225040:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.225042:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869094.227922:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869094.227945:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fe54641/0x2f11f4d3bde2eefb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.227980:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1787869094.227994:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869094.228003:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fe54641/0x2f11f4d3bde2eefb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.228023:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fe54641/0x2f11f4d3bde2eefb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.228036:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fe54641/0x2f11f4d3bde2eefb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.228045:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fe54641/0x2f11f4d3bde2eefb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.228079:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787869094.228131:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869094.228140:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fe54641/0x2f11f4d3bde2eefb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.228150:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787869094.228175:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fe54641/0x2f11f4d3bde2eefb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.228185:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fe54641/0x2f11f4d3bde2eefb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.228206:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fe54641/0x2f11f4d3bde2eefb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.228214:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fe54641/0x2f11f4d3bde2eefb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.228234:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.228236:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.228238:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869094.228636:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869094.228642:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000427d575b/0x2f11f4d3bde2ef02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.228651:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1787869094.228655:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869094.228660:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000427d575b/0x2f11f4d3bde2ef02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.228669:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000427d575b/0x2f11f4d3bde2ef02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.228676:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000427d575b/0x2f11f4d3bde2ef02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.228690:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000427d575b/0x2f11f4d3bde2ef02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.228712:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787869094.228785:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869094.228791:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000427d575b/0x2f11f4d3bde2ef02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.228800:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0e00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787869094.228803:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000427d575b/0x2f11f4d3bde2ef02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.228812:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000427d575b/0x2f11f4d3bde2ef02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.228824:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000427d575b/0x2f11f4d3bde2ef02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.228831:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000427d575b/0x2f11f4d3bde2ef02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.228844:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.228846:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.228848:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869094.229355:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869094.229362:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000468ecd02/0x2f11f4d3bde2ef09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.229372:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1787869094.229376:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869094.229381:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000468ecd02/0x2f11f4d3bde2ef09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.229390:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000468ecd02/0x2f11f4d3bde2ef09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.229399:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000468ecd02/0x2f11f4d3bde2ef09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.229407:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000468ecd02/0x2f11f4d3bde2ef09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.229427:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787869094.229647:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869094.229653:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000468ecd02/0x2f11f4d3bde2ef09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.229662:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0c00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787869094.229665:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000468ecd02/0x2f11f4d3bde2ef09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.229685:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000468ecd02/0x2f11f4d3bde2ef09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.229697:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000468ecd02/0x2f11f4d3bde2ef09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.229704:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000468ecd02/0x2f11f4d3bde2ef09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.229719:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.229721:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.229722:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869094.230470:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869094.230480:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.230500:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1787869094.230504:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869094.230509:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.230521:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.230531:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.230539:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.230555:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787869094.231033:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869094.231040:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.231050:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1787869094.231054:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869094.231058:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.231068:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.231172:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.231179:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.231194:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787869094.232217:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787869094.232227:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.232238:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869094.232242:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.232252:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.232271:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.232278:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.232299:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869094.232302:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.232308:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869094.232310:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.232326:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.232336:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.232343:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.232356:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869094.232358:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869094.232359:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.232412:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787869094.233214:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.233223:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.233234:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.233238:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.233244:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.233254:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.233262:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.233274:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.233292:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787869094.233442:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869094.233448:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.233456:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869094.233459:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.233466:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.233480:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.233487:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.233512:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.233514:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.233515:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787869094.233819:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.233825:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2ef25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.233834:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.233838:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.233842:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2ef25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.233852:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2ef25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.233860:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2ef25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.233867:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2ef25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.234547:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787869094.235105:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.235113:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.235133:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.235137:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.235143:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.235183:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.235193:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.235200:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.235335:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787869094.235344:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2ef25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.235352:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787869094.235356:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2ef25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.235364:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2ef25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.235380:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2ef25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.235386:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009406369a/0x2f11f4d3bde2ef25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.235404:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787869094.235425:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.235431:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ba00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787869094.235434:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.235441:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.235450:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef2c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.235458:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869094.235459:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869094.235461:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787869094.239104:0:24979:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1787869094.239140:0:24979:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787869094.239144:0:24979:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787869094.239314:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23398:x1874715939712000:12345-0@lo:5:osp-pre-1-1.0 Request processed in 29619us (29704us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787869094.239324:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787869094.239376:0:23398:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1787869094.239384:0:23398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23398:1874715939712000:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787869094.239398:0:23398:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1787869094.239448:0:23398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23398:1874715939712128:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787869094.239543:0:23398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869094.239567:0:23398:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da9162fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787869094.239599:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939712128 00000100:00100000:0.0:1787869094.239605:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939712128 00000100:00100000:0.0:1787869094.239645:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787869094.239654:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23398:x1874715939712128:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787869094.240206:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23398:x1874715939712128:12345-0@lo:900:osp-pre-1-1.0 Request processed in 552us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869094.240217:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787869094.240290:0:23398:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dabec8d2c0 x1874715939712128/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787869110 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869094.240302:0:23398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23398:1874715939712128:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1787869094.241489:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869094.242274:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787869094.242285:0:24907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787869094.243262:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.243271:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.243288:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.243293:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.243299:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.243325:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.243336:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.243346:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.243371:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787869094.243602:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869094.243611:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.243690:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869094.243695:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.243704:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.243722:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.243729:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.243745:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.243747:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.243749:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787869094.244198:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.244205:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.244215:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.244218:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.244223:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.244233:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.244241:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.244260:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.244285:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787869094.244365:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869094.244370:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.244383:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869094.244387:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.244395:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.244408:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.244415:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.244430:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.244431:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.244433:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787869094.244828:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.244834:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.244844:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.244847:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.244852:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.244862:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.244871:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.244879:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.244902:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787869094.244985:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869094.244991:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.244999:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ae00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869094.245002:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.245009:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.245028:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.245036:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.245474:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.245478:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.245480:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787869094.245596:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.245603:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a39eb596/0x2f11f4d3bde2ef48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.245618:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.245622:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.245627:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a39eb596/0x2f11f4d3bde2ef48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.245637:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a39eb596/0x2f11f4d3bde2ef48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.245644:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a39eb596/0x2f11f4d3bde2ef48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.245651:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a39eb596/0x2f11f4d3bde2ef48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.245663:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787869094.246359:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869094.246367:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a39eb596/0x2f11f4d3bde2ef48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.246375:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a200 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787869094.246379:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a39eb596/0x2f11f4d3bde2ef48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.246388:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a39eb596/0x2f11f4d3bde2ef48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.246403:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a39eb596/0x2f11f4d3bde2ef48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.246411:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a39eb596/0x2f11f4d3bde2ef48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.246440:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.246442:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.246444:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787869094.246914:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.246921:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.246931:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.246935:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.246941:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.246951:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.246984:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.246992:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.247042:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787869094.247988:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787869094.247997:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.248008:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b600 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787869094.248012:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.248021:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.248360:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.248377:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057b05a81/0x2f11f4d3bde2ef4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.248394:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869094.248395:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869094.248397:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869094.248805:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869094.248814:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2ef56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.248825:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1787869094.248829:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869094.248834:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2ef56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.248845:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2ef56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.248854:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2ef56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.248860:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2ef56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.248926:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787869094.249530:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869094.249537:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.249548:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1787869094.249551:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869094.249555:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.249577:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.249585:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.249592:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.251501:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787869094.251512:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2ef56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.251526:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1c00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869094.251529:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2ef56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.251540:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2ef56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.251561:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2ef56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.251685:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e6880ae/0x2f11f4d3bde2ef56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.251713:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869094.251730:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.251738:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869094.251741:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.251750:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.251761:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef5d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.251769:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869094.251771:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869094.251773:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.254301:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787869094.254318:0:24907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be64f33d/0x2f11f4d3bde2ef5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.255437:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787869094.257361:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787869094.257377:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.257403:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1787869094.257408:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869094.257416:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.257432:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.257442:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.257450:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.257485:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787869094.257731:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869094.257738:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.257748:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869094.257752:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.257762:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.257791:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.257798:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2ef64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.257818:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869094.257820:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869094.257821:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787869094.259789:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.259804:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.259822:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.259827:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.259833:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.259849:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.259861:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.259868:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.259902:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787869094.260890:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869094.260900:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.260911:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ba00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869094.260916:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.260925:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.260975:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.260984:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeef251/0x2f11f4d3bde2ef6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869094.261001:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.261003:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869094.261009:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787869094.261241:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.261248:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2ef72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.261258:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.261263:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.261268:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2ef72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.261279:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2ef72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.261287:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2ef72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.261295:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2ef72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.261313:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787869094.261384:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787869094.261391:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2ef72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.261398:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ac00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787869094.261402:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2ef72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.261409:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2ef72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.261420:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2ef72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.261427:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065882363/0x2f11f4d3bde2ef72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869094.261442:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869094.261443:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787869094.261445:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787869094.261929:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.261936:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.261945:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.261953:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.261972:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.261983:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.261991:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.261998:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262021:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787869094.262362:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.262368:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262376:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.262378:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.262382:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262390:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262397:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262410:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262424:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787869094.262432:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787869094.262436:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262443:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ae00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869094.262447:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262455:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262468:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262476:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2ef79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262489:0:23808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869094.262493:0:23808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262508:0:23808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1b000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869094.262512:0:23808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262520:0:23808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262530:0:23808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262538:0:23808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d88aae5f/0x2f11f4d3bde2ef80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262550:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869094.262551:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869094.262553:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787869094.262895:0:24907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787869094.262901:0:24907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262911:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787869094.262914:0:24907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869094.262918:0:24907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262927:0:24907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262941:0:24907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262948:0:24907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869094.262981:0:24907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787869094.263201:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869094.263208:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.263216:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1a000 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:0.0:1787869094.263219:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.263228:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869094.263241:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787869094.263244:0:24907:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00010000:00010000:0.0:1787869094.263248:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d3ce21d/0x2f11f4d3bde2ef87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869094.263340:0:24907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:22681:x1874715939711488:12345-0@lo:5:osp-pre-1-0.0 Request processed in 82941us (83090us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869094.263351:0:24907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787869094.263416:0:22681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22681:1874715939711488:0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1787869094.263416:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.263418:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869094.263420:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787869094.263433:0:22681:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1787869094.263483:0:22681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22681:1874715939712256:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787869094.263520:0:22681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869094.263554:0:22681:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daaf7f49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787869094.263680:0:24907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939712256 00000100:00100000:1.0:1787869094.263687:0:24907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939712256 00000100:00100000:1.0:1787869094.263729:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787869094.263738:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22681:x1874715939712256:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787869094.263775:0:24665:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:2.0:1787869094.264247:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787869094.266553:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22681:x1874715939712256:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2810us (3026us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787869094.267129:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787869094.267229:0:22681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22681:1874715939712256:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787869094.267246:0:22681:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:3.0:1787869094.753482:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869095.777311:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787869095.833501:0:25334:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg427-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:2.0:1787869096.695776:0:25386:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787869096.696288:0:25386:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787869096.802354:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787869097.795990:0:25436:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787869097.796533:0:25436:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787869097.828752:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787869098.181261:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869098.181408:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918621184 00000100:00100000:1.0:1787869098.181420:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918621184 00000100:00100000:1.0:1787869098.181520:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:1.0:1787869098.181529:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2402:x1874715918621184:12345-192.168.204.27@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787869098.181570:0:22647:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 9c835a62-7e87-43e5-a943-aa5b200c88fb@192.168.204.27@tcp t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:1.0:1787869098.181603:0:22647:0:(genops.c:1385:class_connect()) connect: client 9c835a62-7e87-43e5-a943-aa5b200c88fb, cookie 0x2f11f4d3bde2ef8e 00000100:00080000:1.0:1787869098.181756:0:22647:0:(import.c:65:import_set_state_nolock()) ffff93d98802c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787869098.181833:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+5:2402:x1874715918621184:12345-192.168.204.27@tcp:250:mount.lustre.0 Request processed in 303us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869098.181842:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 115 00000100:00100000:2.0:1787869098.204294:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869098.205606:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918621312 00000100:00100000:1.0:1787869098.205620:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918621312 00000100:00100000:1.0:1787869098.205696:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:1.0:1787869098.205708:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+5:18125:x1874715918621312:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787869098.205725:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787869098.205745:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1a000/0x2f11f4d3bde2ef95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff52c expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869098.205774:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1a000/0x2f11f4d3bde2ef95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff52c expref: 6 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869098.205785:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1a000/0x2f11f4d3bde2ef95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff52c expref: 6 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869098.205795:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1a000, rc 0) 00000100:00100000:1.0:1787869098.205894:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+6:18125:x1874715918621312:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 188us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869098.205901:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 116 00000100:00100000:2.0:1787869098.212945:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869098.213387:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918621440 00000100:00100000:1.0:1787869098.213403:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918621440 00000100:00100000:1.0:1787869098.213493:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:1.0:1787869098.213507:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+6:18125:x1874715918621440:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787869098.213689:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+6:18125:x1874715918621440:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 184us (765us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787869098.213699:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 117 00000100:00100000:3.0:1787869098.217422:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869098.219221:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918621568 00000100:00100000:0.0:1787869098.219240:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918621568 00000100:00100000:0.0:1787869098.219341:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:0.0:1787869098.219352:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+6:18125:x1874715918621568:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787869098.219370:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869098.219392:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93daace1dc00/0x2f11f4d3bde2ef9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff533 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869098.219424:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93daace1dc00/0x2f11f4d3bde2ef9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff533 expref: 7 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869098.219434:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93daace1dc00/0x2f11f4d3bde2ef9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff533 expref: 7 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869098.219443:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1dc00, rc 0) 00000100:00100000:0.0:1787869098.219514:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+7:18125:x1874715918621568:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 164us (2106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869098.219522:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 118 00000100:00100000:2.0:1787869098.244938:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869098.249559:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918621696 00000100:00100000:3.0:1787869098.249576:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918621696 00000100:00100000:3.0:1787869098.249730:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:3.0:1787869098.249744:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+7:18125:x1874715918621696:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787869098.250110:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+8:18125:x1874715918621696:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 360us (5170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869098.250118:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 119 00000100:00100000:2.0:1787869098.271910:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869098.272147:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918621824 00000100:00100000:1.0:1787869098.272198:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918621824 00000100:00100000:1.0:1787869098.272255:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:1.0:1787869098.272265:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+8:18125:x1874715918621824:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787869098.272437:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+8:18125:x1874715918621824:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 172us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869098.272445:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 120 00000100:00100000:3.0:1787869098.275130:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787869098.275194:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939712384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787869098.275277:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869098.275575:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939712384 00000100:00100000:1.0:1787869098.275583:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939712384 00000100:00100000:1.0:1787869098.275670:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787869098.275751:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939712384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787869098.276182:0:24164:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787869098.276241:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939712384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 563us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869098.276249:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787869098.276839:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da9393e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939712512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787869098.276889:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869098.276961:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939712384:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787869098.277226:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787869098.278346:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939712512 00000100:00100000:1.0:1787869098.278369:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939712512 00000100:00100000:1.0:1787869098.278447:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787869098.278458:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939712512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787869098.278482:0:24164:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787869098.278552:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939712512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869098.278558:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787869098.278644:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da9393e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939712512:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787869098.278796:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787869098.291432:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869098.296365:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918621952 00000100:00100000:3.0:1787869098.296381:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918621952 00000100:00100000:3.0:1787869098.296473:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:3.0:1787869098.296485:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+8:18144:x1874715918621952:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787869098.296665:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+8:18144:x1874715918621952:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 181us (5242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869098.296673:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 121 00000100:00100000:2.0:1787869098.335737:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869098.335999:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918622080 00000100:00100000:0.0:1787869098.336017:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918622080 00000100:00100000:0.0:1787869098.336082:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:0.0:1787869098.336094:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+8:18144:x1874715918622080:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787869098.336533:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+8:18144:x1874715918622080:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 441us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869098.336543:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 122 00000100:00100000:2.0:1787869098.347559:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869098.347652:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918622208 00000100:00100000:1.0:1787869098.347663:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918622208 00000100:00100000:1.0:1787869098.347718:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:1.0:1787869098.347727:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+8:18144:x1874715918622208:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787869098.347892:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+8:18144:x1874715918622208:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 165us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869098.347900:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 123 00000100:00100000:2.0:1787869098.356117:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869098.358329:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918622336 00000100:00100000:0.0:1787869098.358346:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918622336 00000100:00100000:0.0:1787869098.358420:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:0.0:1787869098.358473:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+8:18125:x1874715918622336:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787869098.358492:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869098.358510:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93daace1da00/0x2f11f4d3bde2efa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff564 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869098.358542:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93daace1da00/0x2f11f4d3bde2efa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff564 expref: 9 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869098.358553:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93daace1da00/0x2f11f4d3bde2efa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff564 expref: 9 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869098.358561:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1da00, rc 0) 00000100:00100000:0.0:1787869098.358633:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+9:18125:x1874715918622336:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 164us (2536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869098.358641:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 124 00000100:00100000:2.0:1787869098.366600:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869098.366896:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918622464 00000100:00100000:1.0:1787869098.366910:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918622464 00000100:00100000:1.0:1787869098.366971:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:1.0:1787869098.366982:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+9:18125:x1874715918622464:12345-192.168.204.27@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787869098.367016:0:22648:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787869098.367036:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787869098.367041:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787869098.367043:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787869098.367046:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787869098.367047:0:22648:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787869098.370790:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+9:18125:x1874715918622464:12345-192.168.204.27@tcp:256:mount.lustre.0 Request processed in 3796us (4185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869098.370806:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 125 00000100:00100000:2.0:1787869098.383750:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869098.384643:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918622592 00000100:00100000:1.0:1787869098.384662:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918622592 00000100:00100000:1.0:1787869098.384809:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:1.0:1787869098.384822:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+9:18125:x1874715918622592:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787869098.384848:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787869098.384872:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1ba00/0x2f11f4d3bde2efaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff56b expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869098.384937:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1ba00/0x2f11f4d3bde2efaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff56b expref: 10 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869098.384951:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1ba00/0x2f11f4d3bde2efaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff56b expref: 10 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869098.384962:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1ba00, rc 0) 00000100:00100000:1.0:1787869098.385059:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+10:18125:x1874715918622592:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 239us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869098.385067:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 126 00000100:00100000:2.0:1787869098.394337:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869098.394784:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918622720 00000100:00100000:1.0:1787869098.394798:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918622720 00000100:00100000:1.0:1787869098.394866:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:1.0:1787869098.394893:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+10:18125:x1874715918622720:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787869098.395130:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+10:18125:x1874715918622720:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 254us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869098.395140:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 127 00000100:00100000:3.0:1787869098.400092:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869098.401639:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918622848 00000100:00100000:1.0:1787869098.401662:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918622848 00000100:00100000:1.0:1787869098.401898:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:1.0:1787869098.401913:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+10:18125:x1874715918622848:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787869098.404212:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+10:18125:x1874715918622848:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 2284us (4116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869098.404232:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 128 00000100:00100000:2.0:1787869098.413578:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869098.415221:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918622976 00000100:00100000:1.0:1787869098.415245:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918622976 00000100:00100000:1.0:1787869098.415324:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:1.0:1787869098.415337:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+10:18149:x1874715918622976:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787869098.415938:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+10:18149:x1874715918622976:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 599us (2372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869098.415960:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 129 00000100:00100000:2.0:1787869098.425127:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869098.425413:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918623104 00000100:00100000:1.0:1787869098.425424:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918623104 00000100:00100000:1.0:1787869098.425488:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 130 00000100:00100000:1.0:1787869098.425499:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+10:18149:x1874715918623104:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787869098.425658:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+10:18149:x1874715918623104:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 161us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869098.425667:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 130 00000100:00100000:3.0:1787869098.439366:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869098.439483:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869098.439920:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918623232 00000100:00100000:0.0:1787869098.439931:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918623232 00000100:00100000:0.0:1787869098.439983:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918623488 00000100:00100000:0.0:1787869098.439986:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918623488 00000100:00100000:0.0:1787869098.440002:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:0.0:1787869098.440010:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da9393e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1874715918623232:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787869098.440043:0:22655:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 936101de-59ce-47a1-a4e4-2399b6c68a10@192.168.204.27@tcp t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:0.0:1787869098.440096:0:22655:0:(genops.c:1385:class_connect()) connect: client 936101de-59ce-47a1-a4e4-2399b6c68a10, cookie 0x2f11f4d3bde2efb1 00000004:00100000:0.0:1787869098.440122:0:22655:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787869098.440365:0:22655:0:(import.c:65:import_set_state_nolock()) ffff93d988305000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787869098.440561:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da9393e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+6:2402:x1874715918623232:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 549us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869098.440588:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:0.0:1787869098.440611:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:0.0:1787869098.440616:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6f56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1874715918623488:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787869098.440633:0:22655:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 936101de-59ce-47a1-a4e4-2399b6c68a10@192.168.204.27@tcp t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:0.0:1787869098.440668:0:22655:0:(genops.c:1385:class_connect()) connect: client 936101de-59ce-47a1-a4e4-2399b6c68a10, cookie 0x2f11f4d3bde2efb8 00000004:00100000:0.0:1787869098.440683:0:22655:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787869098.440814:0:22655:0:(import.c:65:import_set_state_nolock()) ffff93dabfa3c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787869098.444301:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6f56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+6:2402:x1874715918623488:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 3675us (4809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869098.444315:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1787869098.456823:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869098.457124:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918623744 00000100:00100000:2.0:1787869098.457135:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918623744 00000100:00100000:2.0:1787869098.457263:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:2.0:1787869098.457275:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+6:18125:x1874715918623744:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787869098.457323:0:22656:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787869098.457430:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+6:18125:x1874715918623744:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 157us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869098.457437:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00080000:0.0:1787869098.459705:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787869098.463400:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869098.463443:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869098.463671:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918623616 00000100:00100000:3.0:1787869098.463682:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918623616 00000100:00100000:3.0:1787869098.463758:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918623360 00000100:00100000:3.0:1787869098.463762:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918623360 00000100:00100000:3.0:1787869098.463782:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:3.0:1787869098.463793:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+6:0:x1874715918623616:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787869098.463836:0:22656:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787869098.463940:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+6:0:x1874715918623616:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 148us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869098.463948:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:3.0:1787869098.463983:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:3.0:1787869098.463992:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+6:0:x1874715918623360:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787869098.464021:0:22656:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787869098.464050:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+6:0:x1874715918623360:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 60us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869098.464056:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00080000:0.0:1787869098.464558:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787869098.468364:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869098.468485:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918623872 00000100:00100000:2.0:1787869098.468500:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918623872 00000100:00100000:2.0:1787869098.468581:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:2.0:1787869098.468592:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+6:18125:x1874715918623872:12345-192.168.204.27@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787869098.468706:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+6:18125:x1874715918623872:12345-192.168.204.27@tcp:40:mount.lustre.0 Request processed in 115us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869098.468714:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:3.0:1787869098.481677:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869098.481811:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869098.481902:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869098.483475:0:24161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918624000 00000100:00100000:1.0:1787869098.483487:0:24161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918624000 00000100:00100000:1.0:1787869098.483536:0:24161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918624128 00000100:00100000:1.0:1787869098.483540:0:24161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918624128 00000100:00100000:1.0:1787869098.483569:0:24161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1787869098.483579:0:24161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2402:x1874715918624000:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787869098.483616:0:24161:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 936101de-59ce-47a1-a4e4-2399b6c68a10@192.168.204.27@tcp t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:1.0:1787869098.483665:0:24161:0:(genops.c:1385:class_connect()) connect: client 936101de-59ce-47a1-a4e4-2399b6c68a10, cookie 0x2f11f4d3bde2efbf 00002000:00100000:1.0:1787869098.483679:0:24161:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 936101de-59ce-47a1-a4e4-2399b6c68a10/ffff93d98802c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787869098.483692:0:24161:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787869098.483913:0:24161:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787869098.483948:0:24161:0:(import.c:65:import_set_state_nolock()) ffff93d98802d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787869098.484069:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:3.0:1787869098.484078:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1874715918624128:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787869098.484099:0:24160:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 936101de-59ce-47a1-a4e4-2399b6c68a10@192.168.204.27@tcp t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:3.0:1787869098.484121:0:24160:0:(genops.c:1385:class_connect()) connect: client 936101de-59ce-47a1-a4e4-2399b6c68a10, cookie 0x2f11f4d3bde2efc6 00002000:00100000:3.0:1787869098.484127:0:24160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 936101de-59ce-47a1-a4e4-2399b6c68a10/ffff93d988acf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787869098.484142:0:24160:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787869098.484278:0:24160:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787869098.484295:0:24160:0:(import.c:65:import_set_state_nolock()) ffff93d988acb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787869098.484349:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+6:2402:x1874715918624128:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 271us (2446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869098.484355:0:24161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+6:2402:x1874715918624000:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 772us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869098.484363:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:1.0:1787869098.484371:0:24161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:0.0:1787869098.487297:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918624256 00000100:00100000:0.0:1787869098.487312:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918624256 00000100:00100000:0.0:1787869098.487377:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:0.0:1787869098.487388:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:936101de-59ce-47a1-a4e4-2399b6c68a10+6:18125:x1874715918624256:12345-192.168.204.27@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787869098.487481:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:936101de-59ce-47a1-a4e4-2399b6c68a10+6:18125:x1874715918624256:12345-192.168.204.27@tcp:900:mount.lustre.0 Request processed in 94us (5816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869098.487490:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:3.0:1787869098.492782:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869098.492948:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918624384 00000100:00100000:2.0:1787869098.492963:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918624384 00000100:00100000:2.0:1787869098.493043:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:2.0:1787869098.493055:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+6:18125:x1874715918624384:12345-192.168.204.27@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787869098.494454:0:22657:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1312us 00000004:00200000:3.0:1787869098.529454:0:22657:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787869098.529658:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+6:18125:x1874715918624384:12345-192.168.204.27@tcp:33:mount.lustre.0 Request processed in 36598us (36884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869098.529693:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:3.0:1787869098.761383:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869098.761508:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918624512 00000100:00100000:2.0:1787869098.761526:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918624512 00000100:00100000:2.0:1787869098.761612:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:2.0:1787869098.761625:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+6:18172:x1874715918624512:12345-192.168.204.27@tcp:101:mkdir.0 00010000:00010000:2.0:1787869098.761646:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869098.761679:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4400/0x2f11f4d3bde2efcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff59c expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869098.761752:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2efd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869098.761768:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2efd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869098.761784:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2efd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787869098.761850:0:22655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787869098.761854:0:22655:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787869098.761909:0:22655:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2efd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869098.761955:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4400/0x2f11f4d3bde2efcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff59c expref: 8 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869098.761976:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2efd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff59c expref: 7 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869098.761984:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e100) 00010000:00010000:2.0:1787869098.761987:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787869098.761990:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a5c00, rc 0) 00000100:00100000:2.0:1787869098.762066:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+7:18172:x1874715918624512:12345-192.168.204.27@tcp:101:mkdir.0 Request processed in 444us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869098.762073:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:3.0:1787869098.785917:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787869098.785944:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939712640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787869098.786064:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869098.786199:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939712640 00000100:00100000:0.0:1787869098.786208:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939712640 00000100:00100000:0.0:1787869098.786268:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787869098.786279:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939712640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787869098.786307:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787869098.786363:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939712640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869098.786386:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787869098.786437:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939712640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787869098.796346:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939712768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787869098.796470:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869098.796631:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939712768 00000100:00100000:1.0:1787869098.796715:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939712768 00000100:00100000:1.0:1787869098.796775:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787869098.796786:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939712768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787869098.796841:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787869098.797468:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939712768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 681us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869098.797476:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787869098.797632:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939712768:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787869098.849409:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869099.297937:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939712896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787869099.298021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869099.298135:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939712896 00000100:00100000:0.0:1787869099.298143:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939712896 00000100:00100000:0.0:1787869099.298233:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787869099.298244:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939712896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787869099.298271:0:24164:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787869099.298318:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939712896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869099.298325:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787869099.298391:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787869099.298427:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939712896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787869099.299290:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787869099.299303:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939713024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787869099.299348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869099.299380:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939713024 00000100:00100000:1.0:1787869099.299386:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939713024 00000100:00100000:1.0:1787869099.299425:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787869099.299433:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939713024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787869099.299449:0:24164:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787869099.299485:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874715939713024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869099.299510:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787869099.299535:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787869099.299563:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939713024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787869099.299911:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939713536:0@lo:400:kworker.0 00000100:00100000:3.0:1787869099.299946:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869099.299965:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939714048:0@lo:400:kworker.0 00000100:00100000:3.0:1787869099.299986:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869099.300016:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787869099.300024:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939713408:0@lo:400:kworker.0 00000100:00100000:3.0:1787869099.300047:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869099.300062:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939713920:0@lo:400:kworker.0 00000100:00100000:3.0:1787869099.300081:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869099.300096:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939714432:0@lo:400:kworker.0 00000100:00100000:3.0:1787869099.300117:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869099.300136:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939713536 00000100:00100000:3.0:1787869099.300140:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939713536 00000100:00100000:3.0:1787869099.300191:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939714048 00000100:00100000:3.0:1787869099.300194:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939714048 00000100:00100000:3.0:1787869099.300212:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939713920 00000100:00100000:3.0:1787869099.300215:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939713920 00000100:00100000:3.0:1787869099.300224:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939714432 00000100:00100000:3.0:1787869099.300226:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939714432 00000100:00100000:3.0:1787869099.300239:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787869099.300246:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939713536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787869099.300302:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939713536:12345-0@lo:400:kworker.0 Request processed in 56us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869099.300308:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787869099.300324:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787869099.300329:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939714048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787869099.300354:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939714048:12345-0@lo:400:kworker.0 Request processed in 26us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869099.300360:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787869099.300371:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787869099.300376:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989056940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939713920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787869099.300402:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989056940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874715939713920:12345-0@lo:400:kworker.0 Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869099.300407:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787869099.300418:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787869099.300424:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989054f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939714432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787869099.300448:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989054f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874715939714432:12345-0@lo:400:kworker.0 Request processed in 25us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869099.300454:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787869099.300491:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874715939713920:0@lo:400:kworker.0 00010000:00080000:3.0:1787869099.300503:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93da98b80b40 x1874715939714432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869099.300513:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3639:1874715939714432:0@lo:400:kworker.0 00000100:00100000:3.0:1787869099.300523:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939713536:0@lo:400:kworker.0 00000100:00100000:3.0:1787869099.300543:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939714048:0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.301579:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939713408 00000100:00100000:1.0:1787869099.301590:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939713408 00000100:00100000:1.0:1787869099.301651:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787869099.301660:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989054780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939713408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.301738:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989054780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939713408:12345-0@lo:400:kworker.0 Request processed in 80us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869099.301744:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787869099.301764:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787869099.301768:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787869099.301800:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939713280:0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.301838:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869099.301886:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939713792:0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.301912:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869099.301930:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da98b82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939714304:0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.301952:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869099.301970:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787869099.301977:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3637:1874715939713152:0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.302021:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869099.302045:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939713664:0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.302069:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869099.302088:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939714176:0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.302113:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869099.302150:0:24161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939713792 00000100:00100000:1.0:1787869099.302195:0:24161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939713792 00000100:00100000:1.0:1787869099.302223:0:24161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787869099.302230:0:24161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939713792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.302267:0:24161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939713792:12345-0@lo:400:kworker.0 Request processed in 37us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869099.302273:0:24161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787869099.302295:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939713280 00000100:00100000:1.0:1787869099.302299:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939713280 00000100:00100000:1.0:1787869099.302317:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939713664 00000100:00100000:1.0:1787869099.302320:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939713664 00000100:00100000:1.0:1787869099.302333:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787869099.302339:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939713280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.302371:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939713280:12345-0@lo:400:kworker.0 Request processed in 32us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869099.302377:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787869099.302389:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787869099.302394:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939713664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.302420:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939713664:12345-0@lo:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869099.302426:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787869099.302444:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939713152 00000100:00100000:1.0:1787869099.302447:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939713152 00000100:00100000:1.0:1787869099.302472:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787869099.302478:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:3637:x1874715939713152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.302509:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:3637:x1874715939713152:12345-0@lo:400:kworker.0 Request processed in 31us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869099.302524:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787869099.302573:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3637:1874715939713152:0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.302585:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939713664:0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.302594:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939713280:0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.302602:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939713792:0@lo:400:kworker.0 00000100:00100000:0.0:1787869099.303054:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939713408:0@lo:400:kworker.0 00000100:00100000:3.0:1787869099.303126:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939714304 00000100:00100000:3.0:1787869099.303131:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939714304 00000100:00100000:3.0:1787869099.303247:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939714176 00000100:00100000:3.0:1787869099.303251:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939714176 00000100:00100000:3.0:1787869099.303267:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787869099.303274:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939714304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787869099.303321:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874715939714304:12345-0@lo:400:kworker.0 Request processed in 47us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869099.303327:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787869099.303341:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787869099.303346:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939714176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787869099.303375:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874715939714176:12345-0@lo:400:kworker.0 Request processed in 28us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869099.303381:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1787869099.303529:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787869099.303534:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787869099.303554:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813e1c0 x1874715939714176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787869099.303566:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3637:1874715939714176:0@lo:400:kworker.0 00000100:00100000:1.0:1787869099.303577:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da98b82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3637:1874715939714304:0@lo:400:kworker.0 00000040:00080000:1.0:1787869099.684024:0:23410:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1787869099.822789:0:24979:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 936101de-59ce-47a1-a4e4-2399b6c68a10 00000001:00080000:2.0:1787869099.822809:0:24979:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:2.0:1787869099.873392:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787869100.809310:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869100.812098:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918624640 00000100:00100000:3.0:1787869100.812115:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918624640 00000100:00100000:3.0:1787869100.812297:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:3.0:1787869100.812309:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+7:18224:x1874715918624640:12345-192.168.204.27@tcp:41:lfs.0 00000100:00080000:1.0:1787869100.812489:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1787869100.812563:0:22656:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787869100.812763:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+7:18224:x1874715918624640:12345-192.168.204.27@tcp:41:lfs.0 Request processed in 455us (3461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869100.812772:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:3.0:1787869100.816867:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869100.816945:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918624768 00000100:00100000:0.0:1787869100.816960:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918624768 00000100:00100000:0.0:1787869100.817204:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:0.0:1787869100.817216:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989056580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+6:18224:x1874715918624768:12345-192.168.204.27@tcp:41:lfs.0 00000004:00000024:0.0:1787869100.817261:0:22654:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787869100.817556:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989056580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+6:18224:x1874715918624768:12345-192.168.204.27@tcp:41:lfs.0 Request processed in 342us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869100.817565:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00080000:1.0:1787869100.817960:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787869100.823838:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869100.824012:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918624896 00000100:00100000:1.0:1787869100.824024:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918624896 00000100:00100000:1.0:1787869100.824219:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:1.0:1787869100.824233:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:936101de-59ce-47a1-a4e4-2399b6c68a10+6:18224:x1874715918624896:12345-192.168.204.27@tcp:13:lfs.0 00002000:00000024:1.0:1787869100.824274:0:24164:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00080000:2.0:1787869100.824422:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787869100.824564:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:936101de-59ce-47a1-a4e4-2399b6c68a10+6:18224:x1874715918624896:12345-192.168.204.27@tcp:13:lfs.0 Request processed in 333us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869100.824572:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:2.0:1787869100.837747:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869100.837901:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918625024 00000100:00100000:1.0:1787869100.837938:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918625024 00000100:00100000:1.0:1787869100.838097:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00100000:1.0:1787869100.838109:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:936101de-59ce-47a1-a4e4-2399b6c68a10+5:18224:x1874715918625024:12345-192.168.204.27@tcp:13:lfs.0 00002000:00000024:1.0:1787869100.838143:0:24164:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787869100.838259:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:936101de-59ce-47a1-a4e4-2399b6c68a10+5:18224:x1874715918625024:12345-192.168.204.27@tcp:13:lfs.0 Request processed in 152us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869100.838266:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 12 00000100:00080000:2.0:1787869100.838734:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787869100.899899:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869101.067865:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869101.068183:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918625152 00000100:00100000:0.0:1787869101.068193:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918625152 00000100:00100000:0.0:1787869101.068257:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:0.0:1787869101.068268:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+10:18256:x1874715918625152:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787869101.068285:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869101.068304:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93daace1ca00/0x2f11f4d3bde2efdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff5a3 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869101.068348:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93daace1ca00/0x2f11f4d3bde2efdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff5a3 expref: 11 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869101.068360:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93daace1ca00/0x2f11f4d3bde2efdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff5a3 expref: 11 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869101.068369:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93daace1ca00, rc 0) 00000100:00100000:0.0:1787869101.068432:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+11:18256:x1874715918625152:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 166us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869101.068440:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 132 00000100:00100000:0.0:1787869101.088149:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869101.088316:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918625280 00000100:00100000:1.0:1787869101.088327:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918625280 00000100:00100000:1.0:1787869101.088384:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:1.0:1787869101.088395:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+11:18256:x1874715918625280:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787869101.088629:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+11:18256:x1874715918625280:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 235us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869101.088639:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 133 00000100:00100000:2.0:1787869101.102507:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869101.102651:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918625408 00000100:00100000:1.0:1787869101.102663:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918625408 00000100:00100000:1.0:1787869101.102725:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:1.0:1787869101.102736:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+11:18256:x1874715918625408:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787869101.102945:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+11:18256:x1874715918625408:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 211us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869101.102953:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 134 00000100:00100000:2.0:1787869101.116364:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869101.116708:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918625536 00000100:00100000:0.0:1787869101.116720:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918625536 00000100:00100000:0.0:1787869101.116788:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:0.0:1787869101.116802:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+11:18263:x1874715918625536:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787869101.117020:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+11:18263:x1874715918625536:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 220us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869101.117028:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 135 00000100:00100000:0.0:1787869101.154133:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869101.154401:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918625664 00000100:00100000:2.0:1787869101.154415:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918625664 00000100:00100000:2.0:1787869101.154478:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:2.0:1787869101.154490:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+11:18263:x1874715918625664:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787869101.154884:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+11:18263:x1874715918625664:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 394us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869101.154891:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 136 00000100:00100000:2.0:1787869101.158295:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869101.165131:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918625792 00000100:00100000:1.0:1787869101.165150:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918625792 00000100:00100000:1.0:1787869101.165262:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:1.0:1787869101.165273:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+11:18263:x1874715918625792:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787869101.165895:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+11:18263:x1874715918625792:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 621us (7607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869101.165905:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 137 00000100:00100000:3.0:1787869101.177945:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869101.178078:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918625920 00000100:00100000:2.0:1787869101.178091:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918625920 00000100:00100000:2.0:1787869101.178152:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:2.0:1787869101.178340:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+11:18256:x1874715918625920:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787869101.178357:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869101.178375:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2efe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff5d4 expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869101.178405:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2efe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff5d4 expref: 12 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869101.178416:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab52a5e00/0x2f11f4d3bde2efe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff5d4 expref: 12 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869101.178424:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a5e00, rc 0) 00000100:00100000:2.0:1787869101.178498:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+12:18256:x1874715918625920:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 171us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869101.186616:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 138 00000100:00100000:3.0:1787869101.186802:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869101.187096:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918626048 00000100:00100000:1.0:1787869101.187113:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918626048 00000100:00100000:1.0:1787869101.187221:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:1.0:1787869101.187234:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+12:18256:x1874715918626048:12345-192.168.204.27@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787869101.187268:0:22648:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787869101.187304:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787869101.187308:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787869101.187311:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787869101.187314:0:22648:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787869101.187317:0:22648:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787869101.190840:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+12:18256:x1874715918626048:12345-192.168.204.27@tcp:256:mount.lustre.0 Request processed in 3579us (4016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869101.190862:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 139 00000100:00100000:2.0:1787869101.199271:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869101.201539:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918626176 00000100:00100000:1.0:1787869101.201558:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918626176 00000100:00100000:1.0:1787869101.201639:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:1.0:1787869101.201652:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+12:18256:x1874715918626176:12345-192.168.204.27@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787869101.201671:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787869101.201692:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6f1b600/0x2f11f4d3bde2efe9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff5db expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869101.201724:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6f1b600/0x2f11f4d3bde2efe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff5db expref: 13 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869101.201756:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6f1b600/0x2f11f4d3bde2efe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff5db expref: 13 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869101.201766:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1b600, rc 0) 00000100:00100000:1.0:1787869101.201857:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:18256:x1874715918626176:12345-192.168.204.27@tcp:101:mount.lustre.0 Request processed in 207us (2595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869101.201863:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 140 00000100:00100000:0.0:1787869101.204552:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869101.204848:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918626304 00000100:00100000:1.0:1787869101.204861:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918626304 00000100:00100000:1.0:1787869101.205062:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:1.0:1787869101.205076:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:18256:x1874715918626304:12345-192.168.204.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787869101.205376:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:18256:x1874715918626304:12345-192.168.204.27@tcp:501:mount.lustre.0 Request processed in 302us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869101.205386:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 141 00000100:00100000:3.0:1787869101.208077:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869101.208226:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918626432 00000100:00100000:0.0:1787869101.208239:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918626432 00000100:00100000:0.0:1787869101.209012:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:0.0:1787869101.209027:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:18256:x1874715918626432:12345-192.168.204.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787869101.209335:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:18256:x1874715918626432:12345-192.168.204.27@tcp:503:mount.lustre.0 Request processed in 310us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869101.209344:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 142 00000100:00100000:3.0:1787869101.215484:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869101.215671:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918626560 00000100:00100000:1.0:1787869101.215688:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918626560 00000100:00100000:1.0:1787869101.215778:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:1.0:1787869101.215791:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:18269:x1874715918626560:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787869101.216043:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:18269:x1874715918626560:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 253us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869101.216052:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 143 00000100:00100000:3.0:1787869101.222081:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869101.222130:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918626688 00000100:00100000:2.0:1787869101.222147:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918626688 00000100:00100000:2.0:1787869101.222281:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 144 00000100:00100000:2.0:1787869101.222295:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:18269:x1874715918626688:12345-192.168.204.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787869101.222537:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:18269:x1874715918626688:12345-192.168.204.27@tcp:502:llog_process_th.0 Request processed in 244us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869101.222547:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 144 00000100:00100000:3.0:1787869101.245373:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869101.246042:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918626816 00000100:00100000:0.0:1787869101.246061:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918626816 00000100:00100000:0.0:1787869101.246136:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:0.0:1787869101.246149:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1874715918626816:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787869101.246218:0:22656:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 4fbf5987-99e2-47fc-b779-44fc89496406@192.168.204.27@tcp t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:0.0:1787869101.246279:0:22656:0:(genops.c:1385:class_connect()) connect: client 4fbf5987-99e2-47fc-b779-44fc89496406, cookie 0x2f11f4d3bde2eff0 00000004:00100000:0.0:1787869101.246320:0:22656:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787869101.246466:0:22656:0:(import.c:65:import_set_state_nolock()) ffff93d98714f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787869101.246595:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4fbf5987-99e2-47fc-b779-44fc89496406+6:2402:x1874715918626816:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 447us (3017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869101.246614:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1787869101.247978:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869101.248688:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918627072 00000100:00100000:0.0:1787869101.248705:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918627072 00000100:00100000:0.0:1787869101.248782:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:0.0:1787869101.248793:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989056d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1874715918627072:12345-192.168.204.27@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787869101.248849:0:22655:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 4fbf5987-99e2-47fc-b779-44fc89496406@192.168.204.27@tcp t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:0.0:1787869101.248911:0:22655:0:(genops.c:1385:class_connect()) connect: client 4fbf5987-99e2-47fc-b779-44fc89496406, cookie 0x2f11f4d3bde2eff7 00000004:00100000:0.0:1787869101.248947:0:22655:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787869101.249125:0:22655:0:(import.c:65:import_set_state_nolock()) ffff93d987148000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787869101.249262:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989056d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4fbf5987-99e2-47fc-b779-44fc89496406+6:2402:x1874715918627072:12345-192.168.204.27@tcp:38:mount.lustre.0 Request processed in 469us (3668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869101.249271:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1787869101.256535:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869101.261292:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869101.262649:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869101.263150:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918627328 00000100:00100000:1.0:1787869101.263184:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918627328 00000100:00100000:1.0:1787869101.263283:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918627200 00000100:00100000:1.0:1787869101.263287:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918627200 00000100:00100000:1.0:1787869101.263336:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:1.0:1787869101.263348:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+6:18256:x1874715918627328:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787869101.263404:0:22654:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787869101.263512:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+6:18256:x1874715918627328:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 167us (6996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869101.263521:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:1.0:1787869101.263543:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:1.0:1787869101.263549:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+6:0:x1874715918627200:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787869101.263569:0:22654:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787869101.263616:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+6:0:x1874715918627200:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 67us (2342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869101.263623:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00080000:3.0:1787869101.264612:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787869101.264623:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787869101.271129:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869101.272694:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918626944 00000100:00100000:3.0:1787869101.272717:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918626944 00000100:00100000:2.0:1787869101.272842:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918627456 00000100:00100000:2.0:1787869101.272848:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918627456 00000100:00100000:2.0:1787869101.272876:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:2.0:1787869101.272887:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93093c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4fbf5987-99e2-47fc-b779-44fc89496406+7:0:x1874715918626944:12345-192.168.204.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787869101.272943:0:22656:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787869101.273051:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93093c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4fbf5987-99e2-47fc-b779-44fc89496406+7:0:x1874715918626944:12345-192.168.204.27@tcp:41:mount.lustre.0 Request processed in 165us (10413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869101.273060:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:2.0:1787869101.273083:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1787869101.273090:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93090780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4fbf5987-99e2-47fc-b779-44fc89496406+6:18256:x1874715918627456:12345-192.168.204.27@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787869101.273123:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93090780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4fbf5987-99e2-47fc-b779-44fc89496406+6:18256:x1874715918627456:12345-192.168.204.27@tcp:40:mount.lustre.0 Request processed in 34us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869101.273178:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1787869101.276749:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869101.276878:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918627840 00000100:00100000:0.0:1787869101.276893:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918627840 00000100:00100000:0.0:1787869101.277001:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:0.0:1787869101.277015:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da930930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4fbf5987-99e2-47fc-b779-44fc89496406+6:18256:x1874715918627840:12345-192.168.204.27@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787869101.277138:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da930930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4fbf5987-99e2-47fc-b779-44fc89496406+6:18256:x1874715918627840:12345-192.168.204.27@tcp:900:mount.lustre.0 Request processed in 126us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869101.277148:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:3.0:1787869101.281118:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869101.281209:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869101.281553:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918627584 00000100:00100000:2.0:1787869101.281567:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918627584 00000100:00100000:2.0:1787869101.281635:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918627712 00000100:00100000:2.0:1787869101.281638:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918627712 00000100:00100000:2.0:1787869101.281666:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1787869101.281680:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2402:x1874715918627584:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787869101.281742:0:24162:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 4fbf5987-99e2-47fc-b779-44fc89496406@192.168.204.27@tcp t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:2.0:1787869101.281811:0:24162:0:(genops.c:1385:class_connect()) connect: client 4fbf5987-99e2-47fc-b779-44fc89496406, cookie 0x2f11f4d3bde2effe 00002000:00100000:2.0:1787869101.281839:0:24162:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4fbf5987-99e2-47fc-b779-44fc89496406/ffff93d9822ad800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787869101.281856:0:24162:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787869101.281965:0:24162:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787869101.282038:0:24162:0:(import.c:65:import_set_state_nolock()) ffff93d9822aa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787869101.282148:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4fbf5987-99e2-47fc-b779-44fc89496406+6:2402:x1874715918627584:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 470us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869101.282180:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1787869101.282204:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:2.0:1787869101.282210:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2402:x1874715918627712:12345-192.168.204.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787869101.282230:0:24162:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 4fbf5987-99e2-47fc-b779-44fc89496406@192.168.204.27@tcp t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:2.0:1787869101.282252:0:24162:0:(genops.c:1385:class_connect()) connect: client 4fbf5987-99e2-47fc-b779-44fc89496406, cookie 0x2f11f4d3bde2f005 00002000:00100000:2.0:1787869101.282257:0:24162:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4fbf5987-99e2-47fc-b779-44fc89496406/ffff93d9822a9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113963 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787869101.282264:0:24162:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787869101.282335:0:24162:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787869101.282352:0:24162:0:(import.c:65:import_set_state_nolock()) ffff93d9822ab000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787869101.282378:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4fbf5987-99e2-47fc-b779-44fc89496406+6:2402:x1874715918627712:12345-192.168.204.27@tcp:8:mount.lustre.0 Request processed in 167us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869101.282385:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:2.0:1787869101.287081:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869101.287133:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869101.287204:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869101.287232:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869101.287250:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869101.287265:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869101.287295:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918628352 00000100:00100000:2.0:1787869101.287307:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918628352 00000100:00100000:2.0:1787869101.287364:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918628480 00000100:00100000:2.0:1787869101.287366:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918628480 00000100:00100000:2.0:1787869101.287386:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1787869101.287396:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+6:2404:x1874715918628352:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787869101.287482:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+6:2404:x1874715918628352:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 88us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869101.287490:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:2.0:1787869101.287507:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:2.0:1787869101.287512:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2404:x1874715918628480:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787869101.287532:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2404:x1874715918628480:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 21us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869101.287538:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:2.0:1787869101.287573:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869101.287776:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918628096 00000100:00100000:1.0:1787869101.287780:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918628096 00000100:00100000:1.0:1787869101.287813:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918628608 00000100:00100000:1.0:1787869101.287815:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918628608 00000100:00100000:1.0:1787869101.287837:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918628224 00000100:00100000:1.0:1787869101.287839:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918628224 00000100:00100000:1.0:1787869101.287853:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:1.0:1787869101.287860:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+7:2404:x1874715918628096:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787869101.287891:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+7:2404:x1874715918628096:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 33us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869101.287898:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:1.0:1787869101.287909:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:1.0:1787869101.287915:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+6:2404:x1874715918628608:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787869101.287955:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+6:2404:x1874715918628608:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 40us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869101.287961:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:1.0:1787869101.287971:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:1.0:1787869101.287976:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+6:2404:x1874715918628224:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787869101.287998:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+6:2404:x1874715918628224:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 22us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869101.288004:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:1.0:1787869101.288028:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918627968 00000100:00100000:1.0:1787869101.288032:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918627968 00000100:00100000:1.0:1787869101.288058:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:1.0:1787869101.288064:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:2404:x1874715918627968:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787869101.288090:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:2404:x1874715918627968:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 26us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869101.288096:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 145 00000100:00100000:0.0:1787869101.288755:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918628736 00000100:00100000:0.0:1787869101.288763:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918628736 00000100:00100000:0.0:1787869101.288830:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:0.0:1787869101.288842:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4fbf5987-99e2-47fc-b779-44fc89496406+6:18256:x1874715918628736:12345-192.168.204.27@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787869101.288996:0:22658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787869101.289076:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4fbf5987-99e2-47fc-b779-44fc89496406+6:18256:x1874715918628736:12345-192.168.204.27@tcp:33:mount.lustre.0 Request processed in 238us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869101.289083:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:2.0:1787869101.494671:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869101.494833:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918628864 00000100:00100000:1.0:1787869101.494847:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918628864 00000100:00100000:1.0:1787869101.499406:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:1.0:1787869101.499446:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+6:18292:x1874715918628864:12345-192.168.204.27@tcp:101:mkdir.0 00010000:00010000:1.0:1787869101.499498:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787869101.499533:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2f00c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff60c expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869101.499621:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2f013 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869101.499658:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2f013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869101.499674:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2f013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787869101.499753:0:22654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787869101.499758:0:22654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787869101.499790:0:22654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2f013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869101.499836:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b000/0x2f11f4d3bde2f00c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff60c expref: 8 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869101.499860:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2f013 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff60c expref: 7 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869101.499869:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e100) 00010000:00010000:1.0:1787869101.499872:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787869101.499876:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1ae00, rc 0) 00000100:00100000:1.0:1787869101.499974:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+7:18292:x1874715918628864:12345-192.168.204.27@tcp:101:mkdir.0 Request processed in 551us (5317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869101.499982:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00010000:00010000:0.0:1787869101.923525:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869102.947314:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869103.393452:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787869103.393479:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939714560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787869103.393552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869103.394389:0:24163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939714560 00000100:00100000:3.0:1787869103.394400:0:24163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939714560 00000100:00100000:3.0:1787869103.394480:0:24163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787869103.394491:0:24163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939714560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787869103.394524:0:24163:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787869103.394592:0:24163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939714560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869103.394600:0:24163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787869103.394720:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787869103.394760:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939714560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787869103.395052:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939714688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787869103.395087:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869103.395740:0:24163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939714688 00000100:00100000:1.0:1787869103.395748:0:24163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939714688 00000100:00100000:1.0:1787869103.395817:0:24163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787869103.395827:0:24163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939714688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787869103.395843:0:24163:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00080000:2.0:1787869103.396039:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787869103.396106:0:24163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939714688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 280us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869103.396115:0:24163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787869103.396205:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939714688:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787869103.907829:0:24156:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4fbf5987-99e2-47fc-b779-44fc89496406 00000001:00100000:2.0:1787869103.907851:0:24156:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 936101de-59ce-47a1-a4e4-2399b6c68a10 00000100:00100000:1.0:1787869103.912477:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787869103.912503:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939714816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787869103.912582:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869103.912807:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939714816 00000100:00100000:2.0:1787869103.912816:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939714816 00000100:00100000:0.0:1787869103.912826:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787869103.912838:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939714944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787869103.912860:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787869103.912869:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939714816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787869103.912904:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787869103.912929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869103.912955:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939714816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869103.912962:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787869103.912978:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939714944 00000100:00100000:2.0:1787869103.912981:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939714944 00000100:00100000:2.0:1787869103.912996:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787869103.913002:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabec8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939714944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787869103.913031:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787869103.913067:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabec8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939714944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869103.913082:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787869103.913122:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939714944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787869103.913434:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9863c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939714816:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1787869103.916722:0:23387:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4fbf5987-99e2-47fc-b779-44fc89496406 00000001:00100000:3.0:1787869103.916735:0:23387:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 936101de-59ce-47a1-a4e4-2399b6c68a10 00000001:00100000:2.0:1787869103.922437:0:22634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4fbf5987-99e2-47fc-b779-44fc89496406 00000001:00100000:2.0:1787869103.922456:0:22634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 936101de-59ce-47a1-a4e4-2399b6c68a10 00010000:00010000:3.0:1787869103.970987:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787869104.346348:0:25534:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:1.0:1787869104.354085:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787869104.418392:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989057840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939715072:0@lo:400:kworker.0 00000100:00100000:3.0:1787869104.418474:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869104.418511:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989054b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939715584:0@lo:400:kworker.0 00000100:00100000:3.0:1787869104.418559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869104.418578:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939716096:0@lo:400:kworker.0 00000100:00100000:3.0:1787869104.418601:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869104.418627:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787869104.418633:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989057c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939715456:0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.418878:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939715200:0@lo:400:kworker.0 00000100:00100000:2.0:1787869104.419544:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939715072 00000100:00100000:2.0:1787869104.419552:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939715072 00000100:00100000:2.0:1787869104.419603:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787869104.419612:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:3639:x1874715939715072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.421505:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869104.421569:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939715712:0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.421620:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869104.421639:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939716224:0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.421678:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869104.421708:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787869104.421715:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939715328:0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.421736:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869104.421752:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da98b82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939715840:0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.421785:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869104.421802:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939716352:0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.421822:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869104.422029:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939715584 00000100:00100000:1.0:1787869104.422037:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939715584 00000100:00100000:1.0:1787869104.422085:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939715200 00000100:00100000:1.0:1787869104.422088:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939715200 00000100:00100000:1.0:1787869104.422102:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939715712 00000100:00100000:1.0:1787869104.422112:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939715712 00000100:00100000:1.0:1787869104.422137:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939715328 00000100:00100000:1.0:1787869104.422139:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939715328 00000100:00100000:1.0:1787869104.422176:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787869104.422186:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939715584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.422239:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939715584:12345-0@lo:400:kworker.0 Request processed in 55us (3679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869104.422247:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787869104.422264:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787869104.422271:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939715200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.422304:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939715200:12345-0@lo:400:kworker.0 Request processed in 34us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869104.422311:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787869104.422322:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787869104.422328:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939715712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.422354:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939715712:12345-0@lo:400:kworker.0 Request processed in 27us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869104.422360:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787869104.422368:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787869104.422374:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939715328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.422396:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939715328:12345-0@lo:400:kworker.0 Request processed in 22us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869104.422412:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787869104.422472:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939716096 00000100:00100000:1.0:1787869104.422475:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939716096 00000100:00100000:1.0:1787869104.422495:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939716224 00000100:00100000:1.0:1787869104.422498:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939716224 00000100:00100000:1.0:1787869104.422517:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939715840 00000100:00100000:1.0:1787869104.422584:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939715840 00000100:00100000:1.0:1787869104.422603:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939716352 00000100:00100000:1.0:1787869104.422606:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939716352 00000100:00100000:1.0:1787869104.422622:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787869104.422628:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939716096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.422735:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874715939716096:12345-0@lo:400:kworker.0 Request processed in 107us (4133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869104.422743:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787869104.422756:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787869104.423053:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939716224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.423088:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939716224:12345-0@lo:400:kworker.0 Request processed in 38us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869104.423094:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787869104.423107:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787869104.423113:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939715840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.423140:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874715939715840:12345-0@lo:400:kworker.0 Request processed in 28us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869104.423146:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787869104.423180:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787869104.423187:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988243c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939716352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.423216:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988243c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874715939716352:12345-0@lo:400:kworker.0 Request processed in 30us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869104.423221:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787869104.423248:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787869104.423252:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787869104.423254:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787869104.423275:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939716480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787869104.423305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869104.423332:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787869104.423337:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939716608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787869104.423357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869104.423381:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939716480 00000100:00100000:1.0:1787869104.423385:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939716480 00000100:00100000:3.0:1787869104.423667:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869104.423694:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939715968:0@lo:400:kworker.0 00000100:00100000:3.0:1787869104.423718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869104.423752:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989054b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939715584:0@lo:400:kworker.0 00010000:00080000:3.0:1787869104.423780:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813e1c0 x1874715939716096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787869104.423793:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3639:1874715939716096:0@lo:400:kworker.0 00000100:00100000:3.0:1787869104.423825:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939715456 00000100:00100000:3.0:1787869104.423828:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939715456 00000100:00100000:3.0:1787869104.423849:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939715968 00000100:00100000:3.0:1787869104.423852:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939715968 00000100:00100000:0.0:1787869104.424043:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1787869104.424057:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939715328:0@lo:400:kworker.0 00000100:00100000:0.0:1787869104.424078:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da98b82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874715939715840:0@lo:400:kworker.0 00010000:00080000:0.0:1787869104.424092:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d98813d680 x1874715939716352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869104.424101:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3636:1874715939716352:0@lo:400:kworker.0 00000100:00100000:0.0:1787869104.424112:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939715200:0@lo:400:kworker.0 00000100:00100000:0.0:1787869104.424122:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939715712:0@lo:400:kworker.0 00000100:00100000:0.0:1787869104.424134:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939716224:0@lo:400:kworker.0 00000100:00100000:3.0:1787869104.424668:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787869104.424677:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939715456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787869104.424735:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939715456:12345-0@lo:400:kworker.0 Request processed in 59us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869104.424742:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787869104.424768:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787869104.424776:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939715968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787869104.424805:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939715968:12345-0@lo:400:kworker.0 Request processed in 30us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869104.424821:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1787869104.424976:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787869104.425018:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989057c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939715456:0@lo:400:kworker.0 00000100:00100000:3.0:1787869104.425029:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da98b80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939715968:0@lo:400:kworker.0 00000100:00100000:1.0:1787869104.425105:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939716608 00000100:00100000:1.0:1787869104.425110:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939716608 00000100:00100000:1.0:1787869104.425129:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787869104.425136:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939716480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787869104.425183:0:24164:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787869104.425231:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874715939716480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869104.425237:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787869104.425252:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787869104.425259:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939716608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787869104.425268:0:24164:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787869104.425293:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939716608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (1935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869104.425299:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787869104.425509:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939716608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787869104.425536:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3638:1874715939716480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787869104.426679:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:3639:x1874715939715072:12345-0@lo:400:kworker.0 Request processed in 7063us (8200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869104.426691:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787869104.430979:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989057840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3639:1874715939715072:0@lo:400:kworker.0 00010000:00010000:0.0:1787869104.993394:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869106.017395:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787869106.394531:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869106.394585:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869106.394617:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869106.394643:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869106.394665:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869106.394686:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869106.394708:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869106.394748:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869106.394769:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869106.394806:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918629248 00000100:00100000:3.0:1787869106.394819:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918629248 00000100:00100000:0.0:1787869106.395002:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918628992 00000100:00100000:0.0:1787869106.395008:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918628992 00000100:00100000:0.0:1787869106.395060:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:0.0:1787869106.395073:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:2406:x1874715918628992:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787869106.395286:0:24161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918629504 00000100:00100000:1.0:1787869106.395291:0:24161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918629504 00000100:00100000:1.0:1787869106.395335:0:24161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918630016 00000100:00100000:1.0:1787869106.395339:0:24161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918630016 00000100:00100000:2.0:1787869106.395341:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918629376 00000100:00100000:2.0:1787869106.395346:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918629376 00000100:00100000:1.0:1787869106.395355:0:24161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918629888 00000100:00100000:1.0:1787869106.395358:0:24161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918629888 00000100:00100000:2.0:1787869106.395368:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:2.0:1787869106.395376:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2406:x1874715918629504:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787869106.395417:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2406:x1874715918629504:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 42us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869106.395418:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:2406:x1874715918628992:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 346us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869106.395426:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 147 00000100:00100000:3.0:1787869106.395709:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918629760 00000100:00100000:3.0:1787869106.395713:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918629760 00000100:00100000:3.0:1787869106.395747:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918629120 00000100:00100000:3.0:1787869106.395751:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918629120 00000100:00100000:3.0:1787869106.395768:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918629632 00000100:00100000:3.0:1787869106.395771:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918629632 00000100:00100000:3.0:1787869106.395788:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:3.0:1787869106.395807:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2406:x1874715918629248:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787869106.395849:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2406:x1874715918629248:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 45us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869106.395857:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:1.0:1787869106.395965:0:24161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:1.0:1787869106.395983:0:24161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4fbf5987-99e2-47fc-b779-44fc89496406+6:2406:x1874715918630016:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787869106.396014:0:24161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4fbf5987-99e2-47fc-b779-44fc89496406+6:2406:x1874715918630016:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 34us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869106.396021:0:24161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:1.0:1787869106.396036:0:24161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:1.0:1787869106.396042:0:24161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989057840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2406:x1874715918629376:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787869106.396070:0:24161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989057840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2406:x1874715918629376:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869106.396077:0:24161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:1.0:1787869106.396091:0:24161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:1.0:1787869106.396097:0:24161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4fbf5987-99e2-47fc-b779-44fc89496406+5:2406:x1874715918629888:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:1.0:1787869106.396146:0:24161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4fbf5987-99e2-47fc-b779-44fc89496406+5:2406:x1874715918629888:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 48us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869106.396153:0:24161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:3.0:1787869106.396689:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:3.0:1787869106.396700:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4fbf5987-99e2-47fc-b779-44fc89496406+5:2406:x1874715918629760:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787869106.396759:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4fbf5987-99e2-47fc-b779-44fc89496406+5:2406:x1874715918629760:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 62us (2114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869106.396767:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:3.0:1787869106.396783:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:3.0:1787869106.396789:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98813d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+6:2406:x1874715918629120:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787869106.396817:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98813d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+6:2406:x1874715918629120:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 28us (2129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869106.396823:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:3.0:1787869106.396836:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:3.0:1787869106.396842:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989057c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4fbf5987-99e2-47fc-b779-44fc89496406+6:2406:x1874715918629632:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787869106.396865:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989057c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4fbf5987-99e2-47fc-b779-44fc89496406+6:2406:x1874715918629632:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869106.396980:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:3.0:1787869106.397047:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00080000:3.0:1787869106.397093:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787869106.397098:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787869106.397102:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787869106.397104:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:0.0:1787869106.980276:0:24979:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4fbf5987-99e2-47fc-b779-44fc89496406 00010000:00010000:1.0:1787869107.043253:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787869107.405610:0:25681:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd21de1900 20000000:00000080:2.0:1787869107.405637:0:25681:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d981b43800 uarg=0000000000000000 20000000:01000000:2.0:1787869107.405724:0:25681:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787869107.405733:0:25681:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787869107.405740:0:25681:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787869107.406589:0:25682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1787869107.406813:0:25681:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787869107.424567:0:25681:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787869107.424722:0:25681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.424770:0:25681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec70 expref: 23 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.424779:0:25681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2ec85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ec7e expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.424786:0:25681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93daace1d800/0x2f11f4d3bde2ecc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ecbd expref: 23 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.424793:0:25681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab52a4000/0x2f11f4d3bde2ee3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2ee37 expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.424804:0:25681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1ba00/0x2f11f4d3bde2efaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff56b expref: 12 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.424812:0:25681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93dab6f1b600/0x2f11f4d3bde2efe9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff5db expref: 12 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.424833:0:25681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.424904:0:25681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1b600/0x2f11f4d3bde2efe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff5db expref: 12 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.424923:0:25681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6f1b600/0x2f11f4d3bde2efe9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff5db expref: 12 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869107.424942:0:25681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989054000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25681:1874715939716736:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787869107.425087:0:25681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1ba00/0x2f11f4d3bde2efaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff56b expref: 12 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.425103:0:25681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6f1ba00/0x2f11f4d3bde2efaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff56b expref: 12 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869107.425113:0:25681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989054b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25681:1874715939716864:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787869107.425197:0:25681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab52a4000/0x2f11f4d3bde2ee3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ee37 expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.425207:0:25681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab52a4000/0x2f11f4d3bde2ee3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ee37 expref: 23 pid: 22649 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869107.425217:0:25681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25681:1874715939716992:0@lo:104: 00000100:00100000:3.0:1787869107.425270:0:25681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787869107.425323:0:25681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93daace1d800/0x2f11f4d3bde2ecc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ecbd expref: 23 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.425331:0:25681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93daace1d800/0x2f11f4d3bde2ecc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ecbd expref: 23 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869107.425339:0:25681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882da1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25681:1874715939717120:0@lo:104: 00000100:00100000:3.0:1787869107.425360:0:25681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787869107.425392:0:25681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2ec85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ec7e expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.425400:0:25681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2ec85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec7e expref: 23 pid: 22649 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869107.425408:0:25681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882da940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25681:1874715939717248:0@lo:104: 00000100:00100000:3.0:1787869107.425428:0:25681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869107.426809:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939716992 00000100:00100000:1.0:1787869107.426825:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939716992 00000100:00100000:1.0:1787869107.426885:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939717120 00000100:00100000:1.0:1787869107.426889:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939717120 00000100:00100000:1.0:1787869107.426902:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939717248 00000100:00100000:1.0:1787869107.426904:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939717248 00000100:00100000:1.0:1787869107.426922:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787869107.426933:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+5:25681:x1874715939716992:12345-0@lo:104: 00010000:00010000:1.0:1787869107.426953:0:22637:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ee3e expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.427080:0:22637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787869107.427087:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+5:25681:x1874715939716992:12345-0@lo:104: Request processed in 156us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869107.427096:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787869107.427118:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787869107.427129:0:22643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787869107.427139:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ee3e expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869107.427147:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1be00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:0.0:1787869107.427151:0:22643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ee3e expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869107.427196:0:22643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ee3e expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787869107.427205:0:22643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ee3e expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787869107.427211:0:22643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787869107.427258:0:22643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ee3e expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.427261:0:25681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2f11f4d3bde2ec70 expref: 23 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869107.427265:0:22643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787869107.427273:0:25681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec70 expref: 23 pid: 22648 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869107.427284:0:25681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25681:1874715939717504:0@lo:104: 00010000:00010000:0.0:1787869107.427288:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ee3e expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869107.427294:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6f1be00/0x2f11f4d3bde2ee37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ee3e expref: -99 pid: 24978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869107.427310:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869107.427312:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787869107.427313:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787869107.427328:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939717376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787869107.427330:0:25681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869107.427344:0:25681:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da91747840 going to sleep for 11 seconds 00000100:00100000:0.0:1787869107.427360:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869107.427368:0:25681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25681:1874715939716992:0@lo:104: 00000100:00100000:0.0:1787869107.427399:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939717376 00000100:00100000:0.0:1787869107.427403:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939717376 00010000:00010000:0.0:1787869107.427425:0:22639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab52a4000/0x2f11f4d3bde2ee3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ee37 expref: 24 pid: 22649 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869107.427451:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787869107.427459:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98b80b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:3636:x1874715939717376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787869107.427477:0:22639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787869107.427483:0:22639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab52a4000/0x2f11f4d3bde2ee3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ee37 expref: 24 pid: 22649 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869107.427493:0:22639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab52a4000/0x2f11f4d3bde2ee3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ee37 expref: 24 pid: 22649 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869107.427508:0:22639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab52a4000/0x2f11f4d3bde2ee3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ee37 expref: 24 pid: 22649 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869107.427522:0:22639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787869107.427550:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98b80b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:3636:x1874715939717376:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869107.427557:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787869107.427588:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dabec8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939717376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787869107.428092:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+4:25681:x1874715939717120:12345-0@lo:104: 00010000:00010000:1.0:1787869107.428107:0:22637:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ecc4 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.428192:0:22637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787869107.428198:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+4:25681:x1874715939717120:12345-0@lo:104: Request processed in 1075us (2837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869107.428206:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787869107.428225:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939717504 00000100:00100000:1.0:1787869107.428229:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939717504 00000100:00100000:1.0:1787869107.428248:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787869107.428255:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+4:25681:x1874715939717248:12345-0@lo:104: 00010000:00010000:1.0:1787869107.428263:0:22637:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ec85 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.428298:0:22637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787869107.428302:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+4:25681:x1874715939717248:12345-0@lo:104: Request processed in 50us (2874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869107.428309:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787869107.428321:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787869107.428327:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882db840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+3:25681:x1874715939717504:12345-0@lo:104: 00010000:00010000:1.0:1787869107.428345:0:22637:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ec77 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.428380:0:22637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787869107.428384:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882db840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+3:25681:x1874715939717504:12345-0@lo:104: Request processed in 58us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869107.428390:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787869107.429082:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787869107.429090:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ecc4 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.429100:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93daace1c600 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787869107.429104:0:22642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ecc4 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.429114:0:22642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ecc4 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787869107.429122:0:22642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ecc4 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869107.429128:0:22642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787869107.429215:0:22642:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ecc4 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.429223:0:22642:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787869107.429256:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ecc4 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.429264:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93daace1c600/0x2f11f4d3bde2ecbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ecc4 expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.429291:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787869107.429297:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ec85 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869107.429299:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988241680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3637:1874715939717632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787869107.429305:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1aa00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787869107.429313:0:22642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ec85 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.429325:0:22642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ec85 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787869107.429332:0:22642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ec85 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869107.429339:0:22642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787869107.429366:0:22642:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec85 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.429373:0:22642:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787869107.429395:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec85 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869107.429409:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787869107.429418:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2ec7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec85 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.429433:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787869107.429437:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2f11f4d3bde2ec77 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.429455:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dabd870c00 already unused, calling callback (ffffffffc142ec20) 10000000:00010000:1.0:1787869107.429460:0:22642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2f11f4d3bde2ec77 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869107.429506:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939717632 00000100:00100000:2.0:1787869107.429515:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939717632 00010000:00010000:2.0:1787869107.429553:0:24187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93daace1d800/0x2f11f4d3bde2ecc4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ecbd expref: 23 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869107.429587:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787869107.429598:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:3637:x1874715939717632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787869107.429613:0:24187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787869107.429620:0:24187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93daace1d800/0x2f11f4d3bde2ecc4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ecbd expref: 23 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869107.429632:0:24187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93daace1d800/0x2f11f4d3bde2ecc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ecbd expref: 23 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869107.429655:0:24187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787869107.429659:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93daace1d800/0x2f11f4d3bde2ecc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ecbd expref: 23 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869107.429680:0:25681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882da1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25681:1874715939717120:0@lo:104: 00000100:00100000:3.0:1787869107.429718:0:25681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882da940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25681:1874715939717248:0@lo:104: 00010000:00010000:1.0:1787869107.429750:0:22642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2f11f4d3bde2ec77 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787869107.429760:0:22642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2f11f4d3bde2ec77 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869107.429765:0:22642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787869107.429789:0:22642:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec77 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.429795:0:22642:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787869107.429804:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec77 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.429812:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.127@tcp lock: ffff93dabd870c00/0x2f11f4d3bde2ec70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2f11f4d3bde2ec77 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.429827:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869107.429829:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869107.429831:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787869107.429844:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787869107.430683:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3638:1874715939717760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787869107.431128:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:3637:x1874715939717632:12345-0@lo:103:ldlm_bl.0 Request processed in 1525us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869107.432033:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787869107.432126:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988241680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3637:1874715939717632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787869107.432546:0:25681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25681:1874715939717504:0@lo:104: 00000100:00100000:3.0:1787869107.432734:0:25681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989054000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25681:1874715939716736:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787869107.432748:0:25681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989054b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25681:1874715939716864:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787869107.432794:0:25681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869107.433286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869107.433432:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787869107.433446:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988241a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3638:1874715939717888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787869107.433513:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787869107.435242:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869107.435407:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939717760 00000100:00100000:2.0:1787869107.435419:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939717760 00010000:00010000:2.0:1787869107.435475:0:22639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2ec85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec7e expref: 22 pid: 22649 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869107.435513:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939717888 00000100:00100000:2.0:1787869107.435516:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939717888 00010000:00010000:2.0:1787869107.435528:0:22639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec70 expref: 23 pid: 22648 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869107.435567:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787869107.435992:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869107.436304:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918630144 00000100:00100000:0.0:1787869107.436310:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918630144 00010000:00010000:0.0:1787869107.436341:0:24187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1b600/0x2f11f4d3bde2efe9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff5db expref: 13 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869107.436362:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787869107.436371:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:3638:x1874715939717888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787869107.436390:0:24187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787869107.436409:0:24187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec70 expref: 23 pid: 22648 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869107.436423:0:24187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec70 expref: 23 pid: 22648 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869107.436474:0:24187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab52a5a00/0x2f11f4d3bde2ec77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec70 expref: 23 pid: 22648 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869107.436493:0:24187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787869107.436574:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882403c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:3638:x1874715939717888:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (3061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869107.436582:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787869107.436605:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:0.0:1787869107.436613:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93daace7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:2404:x1874715918630144:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787869107.436623:0:24187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787869107.436627:0:24187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1b600/0x2f11f4d3bde2efe9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff5db expref: 13 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869107.436637:0:24187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1b600/0x2f11f4d3bde2efe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff5db expref: 13 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869107.436649:0:24187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1b600/0x2f11f4d3bde2efe9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff5db expref: 13 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869107.436658:0:24187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787869107.436722:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93daace7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c835a62-7e87-43e5-a943-aa5b200c88fb+12:2404:x1874715918630144:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 110us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869107.436729:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 13 00000100:00100000:1.0:1787869107.437206:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988241a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3638:1874715939717888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787869107.437231:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:3638:x1874715939717760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787869107.437244:0:22639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787869107.437250:0:22639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2ec85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec7e expref: 21 pid: 22649 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869107.437259:0:22639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2ec85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec7e expref: 21 pid: 22649 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869107.437274:0:22639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1a600/0x2f11f4d3bde2ec85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2f11f4d3bde2ec7e expref: 21 pid: 22649 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869107.437285:0:22639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787869107.437335:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:3638:x1874715939717760:12345-0@lo:103:ldlm_bl.0 Request processed in 1761us (4055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869107.437343:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787869107.437354:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3638:1874715939717760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787869107.437557:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869107.438483:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918630272 00000100:00100000:3.0:1787869107.438493:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918630272 00010000:00010000:3.0:1787869107.438532:0:22640:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93dab6f1ba00/0x2f11f4d3bde2efaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff56b expref: 12 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869107.438602:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 14 00000100:00100000:3.0:1787869107.438627:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98b82580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c835a62-7e87-43e5-a943-aa5b200c88fb+12:2406:x1874715918630272:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787869107.438652:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787869107.438658:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93dab6f1ba00/0x2f11f4d3bde2efaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff56b expref: 12 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.438672:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93dab6f1ba00/0x2f11f4d3bde2efaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff56b expref: 12 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.438691:0:22640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6f1ba00/0x2f11f4d3bde2efaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff56b expref: 12 pid: 22647 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.438715:0:22640:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.438726:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.438746:0:22640:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.438755:0:22640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.438763:0:22640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.438771:0:22640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.438778:0:22640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0a00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869107.438783:0:22640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.438798:0:22640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.438833:0:22640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869107.438847:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787869107.439038:0:25681:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.439048:0:25681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869107.439055:0:25681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93dab6fb0a00/0x2f11f4d3bde2f01a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869107.439127:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98b82580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c835a62-7e87-43e5-a943-aa5b200c88fb+11:2406:x1874715918630272:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 295us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869107.439139:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 14 00010000:00010000:1.0:1787869108.065772:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787869108.515563:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939718016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787869108.515664:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869108.515767:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787869108.515775:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939718144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787869108.515804:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869108.515916:0:24163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939718016 00000100:00100000:3.0:1787869108.515926:0:24163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939718016 00000100:00100000:3.0:1787869108.516000:0:24163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939718144 00000100:00100000:3.0:1787869108.516004:0:24163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939718144 00000100:00100000:3.0:1787869108.516025:0:24163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787869108.516037:0:24163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98b80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939718016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787869108.516073:0:24163:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787869108.516135:0:24163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98b80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939718016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869108.516143:0:24163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787869108.516204:0:24163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787869108.516211:0:24163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9863c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939718144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787869108.516222:0:24163:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787869108.516250:0:24163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9863c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939718144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869108.516256:0:24163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787869108.516306:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939718144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787869108.516334:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939718016:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787869108.518399:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787869108.646107:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869108.646365:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918630400 00000100:00100000:3.0:1787869108.646379:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918630400 00000100:00100000:3.0:1787869108.646494:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:3.0:1787869108.646510:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+6:18761:x1874715918630400:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787869108.646542:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869108.646576:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f021 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff613 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.646696:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f028 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.646717:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f028 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.646733:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f028 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.646752:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f02f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.646760:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f02f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.646768:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f02f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787869108.646918:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787869108.647535:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2f036 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647569:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2f036 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647579:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2f036 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787869108.647631:0:22656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787869108.647636:0:22656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787869108.647702:0:22656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2f036 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647715:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f028 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647723:0:22656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f028 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647730:0:22656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f028 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647737:0:22656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787869108.647742:0:22656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f028 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647750:0:22656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f028 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647765:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e100) 00010000:00010000:3.0:1787869108.647768:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787869108.647785:0:22656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f028 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647802:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f028 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647820:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f02f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647825:0:22656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f02f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647830:0:22656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f02f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647838:0:22656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787869108.647841:0:22656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f02f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647846:0:22656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f02f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647853:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93da82873d00) 00010000:00010000:3.0:1787869108.647856:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787869108.647858:0:22656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f02f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647863:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f02f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647908:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f021 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff613 expref: 8 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647934:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1600/0x2f11f4d3bde2f036 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff613 expref: 7 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.647941:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93da82873e00) 00010000:00010000:3.0:1787869108.647943:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787869108.647945:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1600, rc 0) 00000100:00100000:3.0:1787869108.648042:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+7:18761:x1874715918630400:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 1535us (1947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869108.648052:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:2.0:1787869108.656342:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869108.657337:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918630528 00000100:00100000:1.0:1787869108.657356:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918630528 00000100:00100000:1.0:1787869108.657565:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:1.0:1787869108.657581:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:936101de-59ce-47a1-a4e4-2399b6c68a10+7:18761:x1874715918630528:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787869108.657783:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:936101de-59ce-47a1-a4e4-2399b6c68a10+7:18761:x1874715918630528:12345-192.168.204.27@tcp:900:lhsmtool_posix.0 Request processed in 205us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869108.657792:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:0.0:1787869108.662884:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869108.666241:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918630784 00000100:00100000:3.0:1787869108.666264:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918630784 00000100:00100000:3.0:1787869108.666465:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:3.0:1787869108.666479:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+7:18761:x1874715918630784:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787869108.666507:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869108.666536:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f03d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff61a expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.666649:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f044 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.666668:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f044 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.666693:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f044 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.671531:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f04b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.671568:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f04b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.671581:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f04b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.671723:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2f052 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.671733:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2f052 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.671740:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2f052 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787869108.671751:0:22654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787869108.672388:0:22654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f044 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.672398:0:22654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f044 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.672405:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f044 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.672411:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787869108.672415:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f044 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.672423:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f044 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.672449:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93da82873e00) 00010000:00010000:3.0:1787869108.672452:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787869108.672457:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f044 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.672465:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f044 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.672479:0:22654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f04b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.672486:0:22654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f04b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.672491:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f04b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.672495:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787869108.672498:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f04b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.672503:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f04b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.672510:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93da82873d00) 00010000:00010000:3.0:1787869108.672513:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787869108.672516:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f04b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.672521:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f04b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.674351:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f03d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff61a expref: 10 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.674386:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1000/0x2f11f4d3bde2f052 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff61a expref: 9 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.674397:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da82873f00) 00010000:00010000:3.0:1787869108.674401:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787869108.674405:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1000, rc 0) 00000100:00100000:3.0:1787869108.674511:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+9:18761:x1874715918630784:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 8033us (11639us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787869108.674524:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:0.0:1787869108.680746:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869108.685587:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918630912 00000100:00100000:3.0:1787869108.685612:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918630912 00000100:00100000:3.0:1787869108.686213:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:3.0:1787869108.686229:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+9:18761:x1874715918630912:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787869108.686414:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+9:18761:x1874715918630912:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 189us (5686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869108.686423:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 25 00000100:00100000:0.0:1787869108.710289:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869108.710443:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918631040 00000100:00100000:3.0:1787869108.710457:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918631040 00000100:00100000:3.0:1787869108.710566:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:3.0:1787869108.710581:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+5:18761:x1874715918631040:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1787869108.710786:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787869108.715046:0:22654:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4403us 00000100:00100000:0.0:1787869108.730870:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869108.731485:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787869108.736460:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787869108.736652:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+5:18761:x1874715918631040:12345-192.168.204.27@tcp:59:lhsmtool_posix.0 Request processed in 26065us (26368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869108.736667:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:2.0:1787869108.736723:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918631168 00000100:00100000:2.0:1787869108.736731:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918631168 00000100:00100000:2.0:1787869108.736803:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1787869108.736815:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+9:18767:x1874715918631168:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:2.0:1787869108.736838:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869108.736868:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4400/0x2f11f4d3bde2f060 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff621 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.736983:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4a00/0x2f11f4d3bde2f067 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.737001:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4a00/0x2f11f4d3bde2f067 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.737015:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4a00/0x2f11f4d3bde2f067 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740767:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f06e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740794:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f06e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740808:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f06e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740875:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4a00/0x2f11f4d3bde2f067 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740882:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4a00/0x2f11f4d3bde2f067 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740889:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4a00/0x2f11f4d3bde2f067 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740894:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a4a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787869108.740899:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4a00/0x2f11f4d3bde2f067 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740926:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4a00/0x2f11f4d3bde2f067 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740940:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e100) 00010000:00010000:2.0:1787869108.740943:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787869108.740948:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4a00/0x2f11f4d3bde2f067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740955:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4a00/0x2f11f4d3bde2f067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740970:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f06e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740976:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f06e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740982:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f06e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740987:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a4000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787869108.740990:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f06e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.740999:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f06e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.741009:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff93dab5b3e200) 00010000:00010000:2.0:1787869108.741011:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787869108.741015:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f06e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.741030:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f06e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.741083:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4400/0x2f11f4d3bde2f060 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff621 expref: 10 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.741095:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e100) 00010000:00010000:2.0:1787869108.741098:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787869108.741102:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4400/0x2f11f4d3bde2f060 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff621 expref: 10 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.741116:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a4400, rc 0) 00000100:00100000:2.0:1787869108.741222:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+9:18767:x1874715918631168:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 4408us (10369us total) trans 0 rc 301/301 00000100:00100000:2.0:1787869108.741242:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:0.0:1787869108.750386:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869108.750514:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918631296 00000100:00100000:2.0:1787869108.750531:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918631296 00000100:00100000:2.0:1787869108.750593:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:2.0:1787869108.750607:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:936101de-59ce-47a1-a4e4-2399b6c68a10+9:18767:x1874715918631296:12345-192.168.204.27@tcp:700:lfs.0 00000100:00100000:2.0:1787869108.750722:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:936101de-59ce-47a1-a4e4-2399b6c68a10+9:18767:x1874715918631296:12345-192.168.204.27@tcp:700:lfs.0 Request processed in 119us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869108.750732:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:0.0:1787869108.757094:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869108.757208:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918631552 00000100:00100000:3.0:1787869108.757222:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918631552 00000100:00100000:3.0:1787869108.757306:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:3.0:1787869108.757318:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+9:18767:x1874715918631552:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:3.0:1787869108.757401:0:22654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787869108.757441:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2efd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff59c expref: 9 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.757466:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e100) 00010000:00010000:3.0:1787869108.757473:0:22654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787869108.757556:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.757575:0:22654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2f013 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff60c expref: 5 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.757587:0:22654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.757646:0:22654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2f013 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff60c expref: 5 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.757665:0:22654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2f013 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff60c expref: 5 pid: 22654 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869108.757694:0:22654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22654:1874715939718272:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787869108.757813:0:22654:0:(client.c:2715:ptlrpc_set_wait()) set ffff93da91747a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787869108.760435:0:22654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22654:1874715939718272:192.168.204.27@tcp:104: 00010000:00010000:3.0:1787869108.760499:0:22654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869108.762308:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869108.762410:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918631680 00000100:00100000:2.0:1787869108.762429:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918631680 00010000:00010000:2.0:1787869108.762514:0:22639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2f013 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff60c expref: 6 pid: 22654 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869108.762607:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 15 00000100:00100000:2.0:1787869108.762623:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4fbf5987-99e2-47fc-b779-44fc89496406+6:2404:x1874715918631680:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787869108.762644:0:22639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787869108.762652:0:22639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2f013 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff60c expref: 6 pid: 22654 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.762669:0:22639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2f013 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff60c expref: 6 pid: 22654 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.762715:0:22639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ae00/0x2f11f4d3bde2f013 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff60c expref: 6 pid: 22654 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.762735:0:22639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e100) 00010000:00010000:2.0:1787869108.762740:0:22639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.762750:0:22639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.762761:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.762796:0:22639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787869108.762867:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4fbf5987-99e2-47fc-b779-44fc89496406+5:2404:x1874715918631680:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 251us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869108.762875:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 15 00010000:00010000:3.0:1787869108.762920:0:22654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.762933:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.762969:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f07c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.762984:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f07c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.763001:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f07c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787869108.763024:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787869108.765658:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f083 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.765704:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f083 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.765719:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f083 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787869108.765742:0:22654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014e424cf reply state 00000000199a72fa transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f083 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.765755:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f083 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.765788:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93da82873300) 00010000:00010000:3.0:1787869108.765792:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787869108.765797:0:22654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787869108.765804:0:22654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787869108.765815:0:22654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.765823:0:22654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.765831:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.765838:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787869108.765843:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.765853:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.765865:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e100) 00010000:00010000:3.0:1787869108.765867:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787869108.765872:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.765879:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0c00/0x2f11f4d3bde2f075 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787869108.765904:0:22654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014e424cf reply state 00000000199a72fa transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f07c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.765926:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f07c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.765933:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff93da82873d00) 00010000:00010000:3.0:1787869108.765936:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787869108.765938:0:22654:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787869108.766073:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+10:18767:x1874715918631552:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 8751us (8988us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787869108.766083:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 10000000:01000000:1.0:1787869108.833323:0:22651:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787869108.833336:0:22651:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d987ee3000 from 13 10000000:01000000:1.0:1787869108.833343:0:22651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787869108.833415:0:22651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2f08a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.833429:0:22651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2f08a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.833467:0:22651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2f08a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869108.833503:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988241a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939718400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787869108.833602:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869108.835239:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae727000 going to sleep for 11 seconds 00000100:00100000:2.0:1787869108.837263:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939718400 00000100:00100000:2.0:1787869108.837312:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939718400 00000100:00100000:3.0:1787869108.842465:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787869108.842484:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+20:22651:x1874715939718400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787869108.842512:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869108.842544:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6fb0c00/0x2f11f4d3bde2f091 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2f08a expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.842583:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6fb0c00/0x2f11f4d3bde2f091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2f08a expref: 21 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.842598:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6fb0c00/0x2f11f4d3bde2f091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2f08a expref: 21 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.842610:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0c00, rc 0) 00000100:00100000:3.0:1787869108.842755:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:22651:x1874715939718400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 275us (9153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869108.842763:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787869108.843697:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869108.843967:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988241a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939718400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787869108.844002:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2f08a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2f091 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.844017:0:22651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2f08a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2f091 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869108.844130:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988241a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939718528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787869108.844221:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869108.844258:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae727000 going to sleep for 11 seconds 00000100:00100000:0.0:1787869108.844373:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939718528 00000100:00100000:0.0:1787869108.844381:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939718528 00000100:00100000:0.0:1787869108.844433:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787869108.844443:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:22651:x1874715939718528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787869108.844596:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:22651:x1874715939718528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869108.844604:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787869108.844655:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988241a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939718528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787869108.844701:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882b92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939718656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787869108.844756:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869108.844780:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dabc119d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787869108.844791:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939718656 00000100:00100000:0.0:1787869108.844805:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939718656 00000100:00100000:0.0:1787869108.844821:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787869108.844826:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:22651:x1874715939718656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787869108.844915:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:22651:x1874715939718656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869108.844921:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787869108.845111:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882b92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939718656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787869108.847906:0:25696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:2.0:1787869108.848500:0:25695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918631808 00000100:00100000:2.0:1787869108.848515:0:25695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918631808 00000100:00100000:2.0:1787869108.848608:0:25695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:2.0:1787869108.848631:0:25695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+10:18775:x1874715918631808:12345-192.168.204.27@tcp:101:lctl.0 00010000:00010000:2.0:1787869108.848663:0:25695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869108.848706:0:25695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4400/0x2f11f4d3bde2f098 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff628 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.849093:0:25695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f09f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.849113:0:25695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f09f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.849126:0:25695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f09f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787869108.849223:0:25695:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787869108.849228:0:25695:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787869108.849280:0:25695:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f09f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.849312:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4400/0x2f11f4d3bde2f098 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff628 expref: 12 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.849335:0:25695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4000/0x2f11f4d3bde2f09f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff628 expref: 11 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.849344:0:25695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e200) 00010000:00010000:2.0:1787869108.849367:0:25695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787869108.849372:0:25695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a4000, rc 0) 00000100:00100000:2.0:1787869108.849467:0:25695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+11:18775:x1874715918631808:12345-192.168.204.27@tcp:101:lctl.0 Request processed in 848us (5777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869108.849477:0:25695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000020:01000000:1.0:1787869108.860811:0:22651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787869108.860874:0:22651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787869108.860892:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2f08a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2f091 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.860909:0:22651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1b000/0x2f11f4d3bde2f08a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2f091 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869108.860923:0:22651:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787869108.860927:0:22651:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dab7efc800 from 13 10000000:01000000:1.0:1787869108.860930:0:22651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787869108.861760:0:22651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2f0a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.861772:0:22651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2f0a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.861787:0:22651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2f0a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869108.861824:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939718784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787869108.861935:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869108.862034:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae727b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787869108.862241:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939718784 00000100:00100000:2.0:1787869108.862257:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939718784 00000100:00100000:2.0:1787869108.862332:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787869108.862345:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+21:22651:x1874715939718784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787869108.862365:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869108.862382:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab52a4a00/0x2f11f4d3bde2f0ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2f0a6 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.862413:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab52a4a00/0x2f11f4d3bde2f0ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2f0a6 expref: 22 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.862428:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab52a4a00/0x2f11f4d3bde2f0ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2f0a6 expref: 22 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.862441:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a4a00, rc 0) 00000100:00100000:2.0:1787869108.862510:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:22651:x1874715939718784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869108.862518:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787869108.863379:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939718784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787869108.863406:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2f0a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2f0ad expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.863419:0:22651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2f0a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2f0ad expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869108.863520:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939718912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787869108.863575:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869108.863624:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae727b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787869108.863789:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939718912 00000100:00100000:3.0:1787869108.863815:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939718912 00000100:00100000:3.0:1787869108.863863:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787869108.863874:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:22651:x1874715939718912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787869108.864058:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:22651:x1874715939718912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869108.864067:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787869108.864246:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939718912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787869108.864284:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939719040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787869108.864334:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869108.864361:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae727b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787869108.864796:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939719040 00000100:00100000:2.0:1787869108.864804:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939719040 00000100:00100000:2.0:1787869108.864853:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787869108.864862:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:22651:x1874715939719040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787869108.864988:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:22651:x1874715939719040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869108.865002:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787869108.865050:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939719040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787869108.868448:0:25697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787869108.868844:0:22651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787869108.868883:0:22651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787869108.868901:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2f0a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2f0ad expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.868916:0:22651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1aa00/0x2f11f4d3bde2f0a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2f0ad expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869108.868931:0:22651:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787869108.868934:0:22651:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93da88303000 from 13 10000000:01000000:1.0:1787869108.868938:0:22651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787869108.868989:0:22651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ba00/0x2f11f4d3bde2f0b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.868999:0:22651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ba00/0x2f11f4d3bde2f0b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.869011:0:22651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ba00/0x2f11f4d3bde2f0b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869108.869048:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939719168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787869108.869149:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869108.869234:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939719168 00000100:00100000:1.0:1787869108.869243:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae727b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787869108.869257:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939719168 00000100:00100000:0.0:1787869108.869326:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787869108.869339:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+22:22651:x1874715939719168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787869108.869367:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869108.869385:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2f0bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2f0b4 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.869420:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2f0bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2f0b4 expref: 23 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.869433:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d987286c00/0x2f11f4d3bde2f0bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2f0b4 expref: 23 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.869443:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286c00, rc 0) 00000100:00100000:0.0:1787869108.869504:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:22651:x1874715939719168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869108.869511:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787869108.869566:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939719168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787869108.869583:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ba00/0x2f11f4d3bde2f0b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2f0bb expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.869593:0:22651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ba00/0x2f11f4d3bde2f0b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2f0bb expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869108.869717:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939719296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787869108.869750:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869108.869769:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae727b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787869108.870237:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939719296 00000100:00100000:3.0:1787869108.870244:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939719296 00000100:00100000:3.0:1787869108.870292:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787869108.870302:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:22651:x1874715939719296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787869108.870469:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:22651:x1874715939719296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869108.870478:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787869108.870800:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939719296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787869108.870845:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939719424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787869108.870903:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869108.870942:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae727b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787869108.871007:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939719424 00000100:00100000:0.0:1787869108.871011:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939719424 00000100:00100000:0.0:1787869108.871058:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787869108.871067:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:22651:x1874715939719424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787869108.871215:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:22651:x1874715939719424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869108.871222:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787869108.871345:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939719424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787869108.872535:0:25698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787869108.872876:0:22651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787869108.872907:0:22651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787869108.872922:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ba00/0x2f11f4d3bde2f0b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2f0bb expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.872936:0:22651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1ba00/0x2f11f4d3bde2f0b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2f0bb expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787869108.872950:0:22651:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787869108.872953:0:22651:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93dab523f000 from 13 10000000:01000000:1.0:1787869108.872956:0:22651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787869108.873002:0:22651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2f0c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.873011:0:22651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2f0c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.873024:0:22651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2f0c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869108.873067:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939719552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787869108.873144:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869108.873229:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae727b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787869108.873310:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939719552 00000100:00100000:2.0:1787869108.873319:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939719552 00000100:00100000:2.0:1787869108.873384:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787869108.873394:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+23:22651:x1874715939719552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787869108.873412:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869108.873432:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab52a4400/0x2f11f4d3bde2f0c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2f11f4d3bde2f0c2 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.873460:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab52a4400/0x2f11f4d3bde2f0c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2f11f4d3bde2f0c2 expref: 24 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.873474:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab52a4400/0x2f11f4d3bde2f0c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2f11f4d3bde2f0c2 expref: 24 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869108.873484:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a4400, rc 0) 00000100:00100000:2.0:1787869108.873544:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:22651:x1874715939719552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869108.873551:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787869108.873657:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939719552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787869108.873686:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2f0c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2f0c9 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.873697:0:22651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2f0c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2f11f4d3bde2f0c9 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869108.873775:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939719680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787869108.873806:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869108.873830:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae727b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787869108.873919:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939719680 00000100:00100000:3.0:1787869108.873924:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939719680 00000100:00100000:3.0:1787869108.874032:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787869108.874042:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:22651:x1874715939719680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787869108.874209:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:22651:x1874715939719680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869108.874218:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787869108.874291:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939719680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787869108.874323:0:22651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939719808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787869108.874380:0:22651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869108.874538:0:22651:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae727b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787869108.876347:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939719808 00000100:00100000:2.0:1787869108.876365:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939719808 00000100:00100000:2.0:1787869108.876442:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787869108.876453:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:22651:x1874715939719808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787869108.876879:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:22651:x1874715939719808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 425us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869108.876889:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787869108.877525:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869108.877851:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918631936 00000100:00100000:0.0:1787869108.877861:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918631936 00000100:00100000:0.0:1787869108.878102:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 30 00000100:00100000:0.0:1787869108.878115:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4fbf5987-99e2-47fc-b779-44fc89496406+5:18776:x1874715918631936:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787869108.878140:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869108.878275:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2f0d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff62f expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.878365:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286800/0x2f11f4d3bde2f0d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.878384:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286800/0x2f11f4d3bde2f0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.878401:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286800/0x2f11f4d3bde2f0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787869108.878467:0:22656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787869108.878472:0:22656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787869108.878501:0:22656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286800/0x2f11f4d3bde2f0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.878533:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2f0d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff62f expref: 7 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.878575:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286800/0x2f11f4d3bde2f0d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff62f expref: 6 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.878584:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e200) 00010000:00010000:0.0:1787869108.878588:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787869108.878593:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286800, rc 0) 00000100:00100000:1.0:1787869108.878833:0:22651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d988240f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a462b6e-823a-4baf-a873-a4eb993ef5c7:22651:1874715939719808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787869108.879514:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4fbf5987-99e2-47fc-b779-44fc89496406+6:18776:x1874715918631936:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1397us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869108.879526:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 30 00000040:00080000:3.0:1787869108.880897:0:25699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:0.0:1787869108.882096:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869108.882224:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918632064 00000100:00100000:3.0:1787869108.882238:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918632064 00000100:00100000:3.0:1787869108.882317:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 31 00000100:00100000:3.0:1787869108.882329:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4fbf5987-99e2-47fc-b779-44fc89496406+6:18776:x1874715918632064:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:3.0:1787869108.882379:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869108.882405:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2f0de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff636 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882492:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2f0e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882512:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2f0e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882526:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2f0e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882539:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f0ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882547:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f0ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882554:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f0ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882682:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2f0f3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882691:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2f0f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882697:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2f0f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787869108.882746:0:22655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787869108.882759:0:22655:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787869108.882799:0:22655:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2f0f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882814:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2f0e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882821:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2f0e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882828:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2f0e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882834:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787869108.882840:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2f0e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882848:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2f0e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882863:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e200) 00010000:00010000:3.0:1787869108.882867:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787869108.882873:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2f0e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882880:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0200/0x2f11f4d3bde2f0e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882895:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f0ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882902:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f0ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882919:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f0ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.882925:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787869108.883074:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f0ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.883083:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f0ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.883092:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff93da82873d00) 00010000:00010000:3.0:1787869108.883095:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787869108.883098:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f0ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.883104:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f0ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.883139:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2f0de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff636 expref: 8 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.883152:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2f0f3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff636 expref: 7 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.883194:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93da82873300) 00010000:00010000:3.0:1787869108.883196:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787869108.883199:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0800, rc 0) 00000100:00100000:3.0:1787869108.883292:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4fbf5987-99e2-47fc-b779-44fc89496406+7:18776:x1874715918632064:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 964us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869108.883310:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 31 00000020:01000000:1.0:1787869108.885553:0:22651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787869108.885607:0:22651:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787869108.885634:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2f0c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2f0c9 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.885649:0:22651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.127@tcp lock: ffff93dab6f1a600/0x2f11f4d3bde2f0c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2f11f4d3bde2f0c9 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869108.890326:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869108.890539:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918632192 00000100:00100000:0.0:1787869108.890555:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918632192 00000100:00100000:0.0:1787869108.890749:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:0.0:1787869108.890764:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4fbf5987-99e2-47fc-b779-44fc89496406+5:18776:x1874715918632192:12345-192.168.204.27@tcp:900:lfs.0 00000100:00100000:0.0:1787869108.890899:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4fbf5987-99e2-47fc-b779-44fc89496406+5:18776:x1874715918632192:12345-192.168.204.27@tcp:900:lfs.0 Request processed in 138us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869108.890908:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00080000:3.0:1787869108.892380:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787869108.896379:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869108.896533:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918632448 00000100:00100000:1.0:1787869108.896546:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918632448 00000100:00100000:1.0:1787869108.896635:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 32 00000100:00100000:1.0:1787869108.896649:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+7:18776:x1874715918632448:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1787869108.896690:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787869108.896721:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2f0fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff63d expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787869108.896887:0:22654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787869108.897033:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2f0fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff63d expref: 9 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.897053:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e200) 00010000:00010000:1.0:1787869108.897057:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787869108.897063:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2f0fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff63d expref: 9 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.897080:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1b600, rc 0) 00000100:00100000:1.0:1787869108.897220:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+8:18776:x1874715918632448:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 573us (855us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1787869108.897229:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 32 00000040:00080000:1.0:1787869108.899654:0:23410:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787869108.900374:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869108.900465:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918632704 00000100:00100000:3.0:1787869108.900476:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918632704 00000100:00100000:3.0:1787869108.900543:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:3.0:1787869108.900555:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4fbf5987-99e2-47fc-b779-44fc89496406+8:18776:x1874715918632704:12345-192.168.204.27@tcp:36:lfs.0 00010000:00010000:3.0:1787869108.900626:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787869108.900661:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2f0f3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff636 expref: 8 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.900694:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93da82873300) 00010000:00010000:3.0:1787869108.900701:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787869108.900729:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2f108 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.900746:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2f108 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.900757:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2f108 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787869108.901133:0:22655:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cf49841 reply state 000000009550a632 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2f108 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.901150:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2f108 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.901193:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93da82873300) 00010000:00010000:3.0:1787869108.901195:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1787869108.901215:0:22655:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787869108.901226:0:22655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787869108.901347:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4fbf5987-99e2-47fc-b779-44fc89496406+9:18776:x1874715918632704:12345-192.168.204.27@tcp:36:lfs.0 Request processed in 792us (980us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787869108.901356:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 33 00000100:00100000:2.0:1787869108.905248:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869108.905478:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918632960 00000100:00100000:3.0:1787869108.905492:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918632960 00000100:00100000:3.0:1787869108.905559:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:3.0:1787869108.905572:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4fbf5987-99e2-47fc-b779-44fc89496406+9:18776:x1874715918632960:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787869108.905937:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4fbf5987-99e2-47fc-b779-44fc89496406+10:18776:x1874715918632960:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 357us (695us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1787869108.905947:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:0.0:1787869108.909507:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869108.909612:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918633216 00000100:00100000:1.0:1787869108.909626:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918633216 00000100:00100000:1.0:1787869108.909959:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:1.0:1787869108.909974:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+10:18776:x1874715918633216:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:1.0:1787869108.910035:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787869108.910062:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2f10f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff644 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.910205:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2f116 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.910282:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2f116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.910296:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2f116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.910309:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2f11d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.910316:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2f11d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869108.910323:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2f11d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787869108.910899:0:22654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787869108.911010:0:22654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2f116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911020:0:22654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2f116 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911044:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2f116 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911051:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1be00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787869108.911055:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2f116 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911064:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2f116 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911081:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e200) 00010000:00010000:0.0:1787869108.911085:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787869108.911091:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2f116 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911099:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1be00/0x2f11f4d3bde2f116 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911115:0:22654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2f11d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911121:0:22654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2f11d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911126:0:22654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2f11d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911130:0:22654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ac00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787869108.911133:0:22654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2f11d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911149:0:22654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2f11d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911326:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff93da82873d00) 00010000:00010000:0.0:1787869108.911329:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787869108.911333:0:22654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2f11d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911339:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1ac00/0x2f11f4d3bde2f11d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911388:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2f10f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff644 expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911400:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e200) 00010000:00010000:0.0:1787869108.911402:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787869108.911406:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6f1b600/0x2f11f4d3bde2f10f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff644 expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.911415:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6f1b600, rc 0) 00000100:00100000:0.0:1787869108.911543:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+11:18776:x1874715918633216:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1573us (2053us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1787869108.911554:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 34 00000100:00100000:2.0:1787869108.916710:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869108.917196:0:25695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918633344 00000100:00100000:0.0:1787869108.917212:0:25695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918633344 00000100:00100000:0.0:1787869108.917352:0:25695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:0.0:1787869108.917366:0:25695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4fbf5987-99e2-47fc-b779-44fc89496406+11:18776:x1874715918633344:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787869108.917426:0:25695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869108.917460:0:25695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2f12b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff64b expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.917609:0:25695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2f132 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.917642:0:25695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2f132 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.917666:0:25695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2f132 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787869108.917711:0:25695:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787869108.917717:0:25695:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787869108.917743:0:25695:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2f132 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.917998:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2f12b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff64b expref: 13 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.918025:0:25695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2f132 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff64b expref: 12 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.918034:0:25695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93da82873300) 00010000:00010000:0.0:1787869108.918038:0:25695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787869108.918042:0:25695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286000, rc 0) 00000100:00100000:0.0:1787869108.918143:0:25695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4fbf5987-99e2-47fc-b779-44fc89496406+12:18776:x1874715918633344:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 780us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869108.918151:0:25695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 35 00000100:00100000:2.0:1787869108.923058:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869108.923327:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918633472 00000100:00100000:3.0:1787869108.923342:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918633472 00000100:00100000:3.0:1787869108.923468:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:3.0:1787869108.923481:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4fbf5987-99e2-47fc-b779-44fc89496406+12:18776:x1874715918633472:12345-192.168.204.27@tcp:37:lfs.0 00000100:00100000:3.0:1787869108.929142:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4fbf5987-99e2-47fc-b779-44fc89496406+12:18776:x1874715918633472:12345-192.168.204.27@tcp:37:lfs.0 Request processed in 5646us (6084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869108.929196:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 3 00000100:00100000:0.0:1787869108.933141:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869108.933375:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918633728 00000100:00100000:1.0:1787869108.933389:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918633728 00000100:00100000:1.0:1787869108.933468:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:1.0:1787869108.933482:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93184850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4fbf5987-99e2-47fc-b779-44fc89496406+12:18776:x1874715918633728:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:0.0:1787869108.934094:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93184850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4fbf5987-99e2-47fc-b779-44fc89496406+13:18776:x1874715918633728:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 610us (963us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1787869108.934107:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 4 00000100:00100000:2.0:1787869108.989023:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869108.989197:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918633856 00000100:00100000:0.0:1787869108.989210:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918633856 00000100:00100000:0.0:1787869108.989299:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:0.0:1787869108.989313:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+11:18782:x1874715918633856:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787869108.989339:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869108.989365:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2f139 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff652 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.989451:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f140 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.989469:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f140 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.989483:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f140 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.989496:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f147 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.989504:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.989511:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.989619:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2f14e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.989647:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2f14e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.989655:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2f14e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787869108.989715:0:22656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787869108.989721:0:22656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787869108.989916:0:22656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2f14e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990001:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f140 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990009:0:22656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f140 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990016:0:22656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f140 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990022:0:22656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787869108.990027:0:22656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f140 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990037:0:22656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f140 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990052:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e200) 00010000:00010000:0.0:1787869108.990055:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787869108.990060:0:22656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f140 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990079:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f140 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990098:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990105:0:22656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f147 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990111:0:22656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f147 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990116:0:22656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787869108.990119:0:22656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f147 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990125:0:22656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f147 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990133:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff93da82873d00) 00010000:00010000:0.0:1787869108.990135:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787869108.990138:0:22656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f147 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990143:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f147 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990428:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286600/0x2f11f4d3bde2f139 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff652 expref: 13 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990459:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286200/0x2f11f4d3bde2f14e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff652 expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869108.990467:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93da82873300) 00010000:00010000:0.0:1787869108.990469:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787869108.990472:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286200, rc 0) 00000100:00100000:0.0:1787869108.990577:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+12:18782:x1874715918633856:12345-192.168.204.27@tcp:101:bash.0 Request processed in 1265us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869108.990587:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 36 00000100:00100000:3.0:1787869108.993246:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869108.993498:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918633984 00000100:00100000:1.0:1787869108.993512:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918633984 00000100:00100000:1.0:1787869108.993596:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:1.0:1787869108.993612:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:936101de-59ce-47a1-a4e4-2399b6c68a10+5:18782:x1874715918633984:12345-192.168.204.27@tcp:900:bash.0 00000100:00100000:1.0:1787869108.993801:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:936101de-59ce-47a1-a4e4-2399b6c68a10+5:18782:x1874715918633984:12345-192.168.204.27@tcp:900:bash.0 Request processed in 193us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869108.993810:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:1.0:1787869108.996479:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869108.996639:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918634240 00000100:00100000:3.0:1787869108.996653:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918634240 00000100:00100000:3.0:1787869108.996742:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:3.0:1787869108.996753:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+12:18782:x1874715918634240:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:3.0:1787869108.996791:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869108.996817:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2f155 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff659 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.997264:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.997285:0:22655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2f132 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff64b expref: 12 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.997295:0:22655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.997344:0:22655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2f132 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff64b expref: 12 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869108.997363:0:22655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2f132 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff64b expref: 12 pid: 25695 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869108.997381:0:22655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882da1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22655:1874715939719936:192.168.204.27@tcp:104: 00000100:00100000:3.0:1787869108.997543:0:22655:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9872c93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787869109.001559:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869109.002496:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918634368 00000100:00100000:0.0:1787869109.002512:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918634368 00010000:00010000:0.0:1787869109.002578:0:24187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2f132 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff64b expref: 13 pid: 25695 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869109.002637:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 16 00000100:00100000:0.0:1787869109.002649:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fbf5987-99e2-47fc-b779-44fc89496406+13:2404:x1874715918634368:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787869109.002679:0:24187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787869109.002688:0:24187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2f132 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff64b expref: 13 pid: 25695 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.002705:0:24187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2f132 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff64b expref: 13 pid: 25695 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.002736:0:24187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93da82873300) 00010000:00010000:0.0:1787869109.002742:0:24187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.002785:0:24187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.002794:0:24187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.002823:0:24187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787869109.002898:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4fbf5987-99e2-47fc-b779-44fc89496406+13:2404:x1874715918634368:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 250us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.002906:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 16 00010000:00010000:2.0:1787869109.004576:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286000/0x2f11f4d3bde2f132 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff64b expref: 12 pid: 25695 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869109.004607:0:22655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882da1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22655:1874715939719936:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787869109.004713:0:22655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.004727:0:22655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.004733:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.010472:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5a00/0x2f11f4d3bde2f163 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.010499:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5a00/0x2f11f4d3bde2f163 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.010512:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5a00/0x2f11f4d3bde2f163 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.011822:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f16a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.011872:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f16a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.011883:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f16a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787869109.011896:0:22655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787869109.011927:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.011934:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.011940:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.011946:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787869109.011951:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.011958:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.011972:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93da82873300) 00010000:00010000:2.0:1787869109.011976:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787869109.011980:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.011987:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f15c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787869109.012002:0:22655:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000183aefcd reply state 000000005117a683 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5a00/0x2f11f4d3bde2f163 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.012033:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5a00/0x2f11f4d3bde2f163 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.012040:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff93dab5b3eb00) 00010000:00010000:2.0:1787869109.012052:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787869109.012056:0:22655:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787869109.012096:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2f155 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff659 expref: 15 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.012113:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f16a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff659 expref: 14 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.012120:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:2.0:1787869109.012122:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787869109.012125:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a5c00, rc 0) 00000100:00100000:2.0:1787869109.012446:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+15:18782:x1874715918634240:12345-192.168.204.27@tcp:101:bash.0 Request processed in 15692us (15980us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1787869109.012455:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 37 00000100:00100000:3.0:1787869109.016461:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869109.016549:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918634496 00000100:00100000:2.0:1787869109.016558:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918634496 00000100:00100000:2.0:1787869109.016612:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:2.0:1787869109.016623:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+11:18139:x1874715918634496:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787869109.016642:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869109.016662:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab52a5800/0x2f11f4d3bde2f178 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff660 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.016703:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab52a5800/0x2f11f4d3bde2f178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff660 expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.016733:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab52a5800/0x2f11f4d3bde2f178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff660 expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.016743:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a5800, rc 0) 00000100:00100000:2.0:1787869109.016826:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+12:18139:x1874715918634496:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 205us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869109.016833:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 160 00000100:00100000:0.0:1787869109.024259:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869109.024409:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918634624 00000100:00100000:3.0:1787869109.024423:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918634624 00000100:00100000:3.0:1787869109.024495:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 161 00000100:00100000:3.0:1787869109.024508:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+12:18139:x1874715918634624:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787869109.024999:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+12:18139:x1874715918634624:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 490us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869109.025010:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 161 00000100:00100000:3.0:1787869109.025414:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939720064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787869109.025479:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869109.025647:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939720064 00000100:00100000:1.0:1787869109.025655:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939720064 00000100:00100000:1.0:1787869109.025721:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787869109.025741:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939720064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787869109.025970:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787869109.026043:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939720064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 305us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869109.026052:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787869109.026113:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939720064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787869109.027012:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939720192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787869109.027080:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869109.027461:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939720192 00000100:00100000:0.0:1787869109.027470:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939720192 00000100:00100000:0.0:1787869109.027530:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787869109.027542:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939720192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787869109.027585:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787869109.027663:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939720192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.027685:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787869109.027753:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939720192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787869109.029278:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869109.029914:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918634752 00000100:00100000:0.0:1787869109.029927:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918634752 00000100:00100000:0.0:1787869109.030007:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:0.0:1787869109.030018:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+15:18782:x1874715918634752:12345-192.168.204.27@tcp:101:bash.0 00010000:00010000:0.0:1787869109.030047:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869109.030073:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f17f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff667 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.030218:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f186 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.030235:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f186 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.030250:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f186 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787869109.030318:0:22654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787869109.030324:0:22654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787869109.030350:0:22654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f186 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.030363:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f186 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.030395:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f17f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff667 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.030418:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f186 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff667 expref: 16 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.030427:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:0.0:1787869109.030430:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787869109.030434:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287400, rc 0) 00000100:00100000:0.0:1787869109.030513:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+16:18782:x1874715918634752:12345-192.168.204.27@tcp:101:bash.0 Request processed in 497us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.030522:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 38 00000100:00100000:2.0:1787869109.036142:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869109.036312:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918634880 00000100:00100000:0.0:1787869109.036331:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918634880 00000100:00100000:0.0:1787869109.036421:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 162 00000100:00100000:0.0:1787869109.036437:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98819f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+12:18139:x1874715918634880:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787869109.036689:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98819f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c835a62-7e87-43e5-a943-aa5b200c88fb+12:18139:x1874715918634880:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 254us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.036699:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 162 00000100:00100000:0.0:1787869109.037959:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869109.038039:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918635136 00000100:00100000:3.0:1787869109.038049:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918635136 00000100:00100000:3.0:1787869109.038358:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:3.0:1787869109.038370:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+16:18782:x1874715918635136:12345-192.168.204.27@tcp:35:bash.0 00000100:00100000:3.0:1787869109.038806:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+17:18782:x1874715918635136:12345-192.168.204.27@tcp:35:bash.0 Request processed in 438us (858us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1787869109.038814:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 5 00000100:00100000:1.0:1787869109.043372:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869109.043484:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918635264 00000100:00100000:3.0:1787869109.043500:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918635264 00000100:00100000:3.0:1787869109.043581:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 163 00000100:00100000:3.0:1787869109.043594:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+12:18139:x1874715918635264:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787869109.043620:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869109.043648:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2f18d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff66e expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.043708:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2f18d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff66e expref: 13 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.043722:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93dab6fb0200/0x2f11f4d3bde2f18d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff66e expref: 13 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.043810:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0200, rc 0) 00000100:00100000:3.0:1787869109.044131:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:18139:x1874715918635264:12345-192.168.204.27@tcp:101:ll_cfg_requeue.0 Request processed in 538us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869109.044141:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 163 00000100:00100000:2.0:1787869109.050642:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869109.050903:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918635392 00000100:00100000:3.0:1787869109.050918:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918635392 00000100:00100000:3.0:1787869109.051120:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 164 00000100:00100000:3.0:1787869109.051132:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:18139:x1874715918635392:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787869109.051641:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:18139:x1874715918635392:12345-192.168.204.27@tcp:501:ll_cfg_requeue.0 Request processed in 507us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869109.051652:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 164 00000100:00100000:1.0:1787869109.065260:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869109.065460:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918635520 00000100:00100000:3.0:1787869109.065476:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918635520 00000100:00100000:3.0:1787869109.065606:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 165 00000100:00100000:3.0:1787869109.065619:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:18139:x1874715918635520:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787869109.065884:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:18139:x1874715918635520:12345-192.168.204.27@tcp:503:ll_cfg_requeue.0 Request processed in 266us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869109.065894:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 165 00010000:00010000:1.0:1787869109.089588:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787869109.174880:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869109.175427:0:25695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918635776 00000100:00100000:0.0:1787869109.175441:0:25695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918635776 00000100:00100000:0.0:1787869109.175544:0:25695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:0.0:1787869109.175558:0:25695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+17:18794:x1874715918635776:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787869109.175592:0:25695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869109.175631:0:25695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f194 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff675 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787869109.175796:0:25695:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787869109.175941:0:25695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f194 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff675 expref: 19 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.175958:0:25695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93dab5b3e200) 00010000:00010000:0.0:1787869109.175962:0:25695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787869109.175968:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f194 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff675 expref: 19 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.176441:0:25695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287a00, rc 0) 00000100:00100000:0.0:1787869109.176964:0:25695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+18:18794:x1874715918635776:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 1403us (2092us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1787869109.177078:0:25695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 39 00000100:00100000:2.0:1787869109.183045:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869109.183204:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918636032 00000100:00100000:3.0:1787869109.183220:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918636032 00000100:00100000:3.0:1787869109.183306:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:3.0:1787869109.183320:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+18:18794:x1874715918636032:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787869109.183630:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+19:18794:x1874715918636032:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 312us (601us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1787869109.183640:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 6 00000100:00100000:1.0:1787869109.223308:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869109.224614:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918636288 00000100:00100000:0.0:1787869109.224635:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918636288 00000100:00100000:0.0:1787869109.224754:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:0.0:1787869109.224777:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+19:18797:x1874715918636288:12345-192.168.204.27@tcp:101:lfs.0 00010000:00010000:0.0:1787869109.224812:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869109.224841:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f1a2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff67c expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.224994:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2f1a9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.225013:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2f1a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.225029:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2f1a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787869109.225043:0:22654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787869109.225236:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f1a2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff67c expref: 22 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.225260:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2f1a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff67c expref: 21 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.225271:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:0.0:1787869109.225275:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787869109.225279:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287600, rc 0) 00000100:00100000:0.0:1787869109.225402:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+21:18797:x1874715918636288:12345-192.168.204.27@tcp:101:lfs.0 Request processed in 637us (2110us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1787869109.225411:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 40 00000100:00100000:1.0:1787869109.230693:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869109.230755:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869109.230927:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918636544 00000100:00100000:2.0:1787869109.230941:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918636544 00000100:00100000:2.0:1787869109.231022:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:2.0:1787869109.231034:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988242580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+21:18797:x1874715918636544:12345-192.168.204.27@tcp:54:lfs.0 00010000:00010000:2.0:1787869109.231128:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f1b7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.231205:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f1b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.231221:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f1b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.231268:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f1b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.231275:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f1b7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.231307:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f1b7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.231313:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a4200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787869109.231318:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f1b7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.231326:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f1b7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.231342:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:2.0:1787869109.231346:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787869109.231353:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f1b7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.231359:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f1b7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869109.231454:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988242580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+21:18797:x1874715918636544:12345-192.168.204.27@tcp:54:lfs.0 Request processed in 422us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869109.231462:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 41 00000100:00100000:3.0:1787869109.231897:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918636416 00000100:00100000:3.0:1787869109.231913:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918636416 00000100:00100000:3.0:1787869109.231967:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:3.0:1787869109.231976:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988240b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+21:2404:x1874715918636416:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787869109.231990:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787869109.232012:0:22641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287600/0x2f11f4d3bde2f1a9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff67c expref: 21 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.232025:0:22641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:3.0:1787869109.232029:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787869109.232074:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988240b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+20:2404:x1874715918636416:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 99us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869109.232082:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:1.0:1787869109.234386:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869109.234515:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918636800 00000100:00100000:3.0:1787869109.234527:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918636800 00000100:00100000:3.0:1787869109.234650:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 7 00000100:00100000:3.0:1787869109.234663:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+20:18797:x1874715918636800:12345-192.168.204.27@tcp:35:lfs.0 00000100:00100000:3.0:1787869109.235018:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+21:18797:x1874715918636800:12345-192.168.204.27@tcp:35:lfs.0 Request processed in 357us (647us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1787869109.235027:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 7 00000040:00080000:1.0:1787869109.474054:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787869109.508736:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869109.512050:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918637056 00000100:00100000:3.0:1787869109.512234:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918637056 00000100:00100000:3.0:1787869109.512347:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:3.0:1787869109.512361:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+21:18828:x1874715918637056:12345-192.168.204.27@tcp:101:cat.0 00010000:00010000:3.0:1787869109.512397:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869109.512424:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0600/0x2f11f4d3bde2f1be lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff683 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.512606:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2f1c5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.512624:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2f1c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.512639:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2f1c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787869109.512654:0:22654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787869109.513619:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0600/0x2f11f4d3bde2f1be lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff683 expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.513650:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2f1c5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff683 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.513673:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:3.0:1787869109.513677:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787869109.513681:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0800, rc 0) 00000100:00100000:3.0:1787869109.514870:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+23:18828:x1874715918637056:12345-192.168.204.27@tcp:101:cat.0 Request processed in 2499us (6136us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1787869109.514885:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 42 00000100:00100000:1.0:1787869109.520419:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869109.520554:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918637184 00000100:00100000:0.0:1787869109.520567:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918637184 00000100:00100000:0.0:1787869109.520654:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:0.0:1787869109.520680:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d988241680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+23:2403:x1874715918637184:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787869109.520702:0:24187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787869109.520738:0:24187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0800/0x2f11f4d3bde2f1c5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff683 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.520772:0:24187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:0.0:1787869109.520778:0:24187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787869109.520863:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d988241680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+22:2403:x1874715918637184:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 185us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.520872:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:1.0:1787869109.522496:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869109.525656:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918637440 00000100:00100000:3.0:1787869109.525691:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918637440 00000100:00100000:3.0:1787869109.525785:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:3.0:1787869109.525797:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+22:18828:x1874715918637440:12345-192.168.204.27@tcp:35:cat.0 00000100:00100000:3.0:1787869109.526623:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+23:18828:x1874715918637440:12345-192.168.204.27@tcp:35:cat.0 Request processed in 823us (4136us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1787869109.526651:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 8 00000100:00100000:0.0:1787869109.537623:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939720320:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.537745:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869109.537834:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939720320 00000100:00100000:0.0:1787869109.537844:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939720320 00000100:00100000:0.0:1787869109.537907:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787869109.537918:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:3636:x1874715939720320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.537998:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a462b6e-823a-4baf-a873-a4eb993ef5c7+24:3636:x1874715939720320:12345-0@lo:400:kworker.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.538006:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787869109.538087:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a462b6e-823a-4baf-a873-a4eb993ef5c7:3636:1874715939720320:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.538133:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787869109.538140:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939720448:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.538205:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869109.538265:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939720576:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.538294:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869109.538347:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98813fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939720704:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.538378:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869109.538430:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939720832:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.538457:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869109.538486:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939720448 00000100:00100000:0.0:1787869109.538491:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939720448 00000100:00100000:0.0:1787869109.538522:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939720576 00000100:00100000:0.0:1787869109.538526:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939720576 00000100:00100000:0.0:1787869109.538559:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939720832 00000100:00100000:0.0:1787869109.538562:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939720832 00000100:00100000:0.0:1787869109.538577:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787869109.538584:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939720448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.538625:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939720448:12345-0@lo:400:kworker.0 Request processed in 41us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.538633:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787869109.538645:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787869109.538651:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939720576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.538696:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939720576:12345-0@lo:400:kworker.0 Request processed in 45us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.538702:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787869109.538726:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787869109.538732:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939720832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.538762:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939720832:12345-0@lo:400:kworker.0 Request processed in 30us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.538768:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787869109.538804:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939720576:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.538831:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939720832:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.538840:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882b83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939720448:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.538867:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787869109.538873:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939720960:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.538901:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869109.538922:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939720960 00000100:00100000:0.0:1787869109.538927:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939720960 00000100:00100000:0.0:1787869109.538951:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787869109.538957:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dabe3df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939720960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.538990:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dabe3df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874715939720960:12345-0@lo:400:kworker.0 Request processed in 33us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.538996:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787869109.539191:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3636:1874715939720960:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.539227:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939721088:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.539254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869109.539302:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939721216:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.539325:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869109.539357:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939720704 00000100:00100000:0.0:1787869109.539370:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939720704 00000100:00100000:0.0:1787869109.539398:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939721088 00000100:00100000:0.0:1787869109.539401:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939721088 00000100:00100000:0.0:1787869109.539413:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939721216 00000100:00100000:0.0:1787869109.539416:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939721216 00000100:00100000:0.0:1787869109.539433:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787869109.539440:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939720704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.539477:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874715939720704:12345-0@lo:400:kworker.0 Request processed in 38us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.539483:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787869109.539495:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787869109.539501:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939721088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.539531:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874715939721088:12345-0@lo:400:kworker.0 Request processed in 31us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.539537:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787869109.539548:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787869109.539555:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939721216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.539579:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874715939721216:12345-0@lo:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.539585:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787869109.539609:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3639:1874715939721216:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.539619:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98813fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874715939720704:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.539643:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874715939721088:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.539685:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939721344:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.539709:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869109.539743:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939721344 00000100:00100000:0.0:1787869109.539747:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939721344 00000100:00100000:0.0:1787869109.539768:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787869109.539774:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939721344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.539806:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874715939721344:12345-0@lo:400:kworker.0 Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.539812:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1787869109.539838:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7f6cb40 x1874715939721344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869109.539849:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3636:1874715939721344:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.539877:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787869109.539883:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939721472:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.539908:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869109.539929:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939721472 00000100:00100000:0.0:1787869109.539932:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939721472 00000100:00100000:0.0:1787869109.539952:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787869109.539958:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939721472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.539992:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874715939721472:12345-0@lo:400:kworker.0 Request processed in 34us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.539998:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787869109.540022:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3636:1874715939721472:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.540055:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939721600:0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.540079:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869109.540106:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939721600 00000100:00100000:0.0:1787869109.540109:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939721600 00000100:00100000:0.0:1787869109.540129:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787869109.540142:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939721600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787869109.540204:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874715939721600:12345-0@lo:400:kworker.0 Request processed in 62us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.540210:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787869109.540233:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93dab7f6cb40 x1874715939721600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787869125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787869109.540242:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3638:1874715939721600:0@lo:400:kworker.0 00000100:00100000:1.0:1787869109.541049:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787869109.541065:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939721728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787869109.541130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869109.541219:0:24163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939721728 00000100:00100000:1.0:1787869109.541226:0:24163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939721728 00000100:00100000:1.0:1787869109.541274:0:24163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787869109.541282:0:24163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939721728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787869109.541315:0:24163:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787869109.541369:0:24163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874715939721728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869109.541376:0:24163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787869109.541420:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3638:1874715939721728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787869109.541800:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787869109.541812:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939721856:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787869109.541847:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787869109.541851:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787869109.541855:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787869109.541860:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787869109.541883:0:24163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939721856 00000100:00100000:2.0:1787869109.541886:0:24163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939721856 00000100:00100000:2.0:1787869109.541924:0:24163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787869109.541932:0:24163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939721856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787869109.541947:0:24163:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787869109.542008:0:24163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939721856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869109.542015:0:24163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787869109.542046:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939721856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787869109.616115:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869109.616396:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918637696 00000100:00100000:0.0:1787869109.616411:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918637696 00000100:00100000:0.0:1787869109.616500:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:0.0:1787869109.616513:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+23:18834:x1874715918637696:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:0.0:1787869109.616549:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869109.616578:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f1d3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff68a expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.616741:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2f1da lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.616761:0:22656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f16a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff659 expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.616770:0:22656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f186 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff667 expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.616778:0:22656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2f1da lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.616846:0:22656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f186 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff667 expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.616863:0:22656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f186 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff667 expref: 24 pid: 22654 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869109.616882:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22656:1874715939721984:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787869109.617064:0:22656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f16a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff659 expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.617074:0:22656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f16a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff659 expref: 24 pid: 22655 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869109.617085:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22656:1874715939722112:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787869109.617111:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9872c9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787869109.626326:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22656:1874715939721984:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787869109.626350:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22656:1874715939722112:192.168.204.27@tcp:104: 00010000:00010000:0.0:1787869109.626386:0:22656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2f1da lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869109.626550:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869109.626605:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869109.626701:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918637824 00000100:00100000:2.0:1787869109.626709:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918637824 00010000:00010000:2.0:1787869109.626754:0:22639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f186 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff667 expref: 25 pid: 22654 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869109.626792:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918637952 00000100:00100000:2.0:1787869109.626795:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918637952 00010000:00010000:2.0:1787869109.626809:0:22639:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f16a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff659 expref: 26 pid: 22655 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869109.626837:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1787869109.626847:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+26:2404:x1874715918637824:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787869109.626865:0:22639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787869109.626872:0:22639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f186 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff667 expref: 26 pid: 22654 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.626885:0:22639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f186 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff667 expref: 26 pid: 22654 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.626912:0:22639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287400/0x2f11f4d3bde2f186 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff667 expref: 26 pid: 22654 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.626930:0:22639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:2.0:1787869109.626955:0:22639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2f1da lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.626966:0:22639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2f1da lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.626974:0:22639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787869109.627043:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+25:2404:x1874715918637824:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 196us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869109.627051:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 17 00000100:00100000:2.0:1787869109.627073:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 18 00000100:00100000:2.0:1787869109.627080:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d981b0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+24:2404:x1874715918637952:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787869109.627088:0:22639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787869109.627093:0:22639:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f16a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff659 expref: 24 pid: 22655 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.627104:0:22639:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f16a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff659 expref: 24 pid: 22655 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.627117:0:22639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f16a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff659 expref: 24 pid: 22655 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.627127:0:22639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:2.0:1787869109.627130:0:22639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2f1da lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.627138:0:22639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2f1da lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.627210:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2f1da lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.627237:0:22639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787869109.627258:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d981b0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+23:2404:x1874715918637952:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 179us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869109.627265:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 18 00010000:00010000:0.0:1787869109.627502:0:22656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2f1da lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.627511:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2f1da lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787869109.627546:0:22656:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787869109.627747:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f1d3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff68a expref: 24 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.627765:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286a00/0x2f11f4d3bde2f1da lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff68a expref: 23 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.627774:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:0.0:1787869109.627777:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787869109.627780:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286a00, rc 0) 00000100:00100000:0.0:1787869109.627823:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+23:18834:x1874715918637696:12345-192.168.204.27@tcp:101:dd.0 Request processed in 11312us (11724us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1787869109.627831:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 43 00000100:00100000:1.0:1787869109.631826:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869109.632070:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918638080 00000100:00100000:3.0:1787869109.632084:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918638080 00000100:00100000:3.0:1787869109.632353:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:3.0:1787869109.632368:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+23:18834:x1874715918638080:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:3.0:1787869109.632402:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869109.632430:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0600/0x2f11f4d3bde2f1e8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff691 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.632479:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f1ef lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.632498:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f1ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.632513:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f1ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.632698:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0600/0x2f11f4d3bde2f1e8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff691 expref: 25 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.632718:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f1ef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff691 expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.632728:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:3.0:1787869109.632739:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787869109.632744:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb1200, rc 0) 00000100:00100000:3.0:1787869109.632830:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+24:18834:x1874715918638080:12345-192.168.204.27@tcp:101:dd.0 Request processed in 466us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869109.633089:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 44 00000100:00100000:2.0:1787869109.641411:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869109.643789:0:25695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918638336 00000100:00100000:0.0:1787869109.643814:0:25695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918638336 00000100:00100000:2.0:1787869109.644212:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 45 00000100:00100000:2.0:1787869109.644232:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+24:18834:x1874715918638336:12345-192.168.204.27@tcp:36:dd.0 00010000:00010000:2.0:1787869109.644550:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f1f6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.644574:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f1f6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.644588:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f1f6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787869109.644644:0:22656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1787869109.644675:0:22656:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000356ccac3 reply state 000000008aead2ec transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f1f6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.644690:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f1f6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.644699:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:2.0:1787869109.644702:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787869109.644707:0:22656:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787869109.645041:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+27:18834:x1874715918638336:12345-192.168.204.27@tcp:36:dd.0 Request processed in 814us (3645us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1787869109.645050:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 45 00000020:00080000:2.0:1787869109.645057:0:22656:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787869109.652515:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869109.654962:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918638464 00000100:00100000:3.0:1787869109.654988:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918638464 00000100:00100000:3.0:1787869109.655214:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:3.0:1787869109.655231:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+27:18834:x1874715918638464:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:3.0:1787869109.655268:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787869109.655299:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0600/0x2f11f4d3bde2f1fd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff698 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.655393:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0600/0x2f11f4d3bde2f1fd lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff698 expref: 28 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.655411:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0600/0x2f11f4d3bde2f1fd lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff698 expref: 28 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869109.655435:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:3.0:1787869109.655440:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787869109.655445:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab6fb0600, rc 0) 00000100:00100000:3.0:1787869109.655545:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+28:18834:x1874715918638464:12345-192.168.204.27@tcp:101:dd.0 Request processed in 318us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869109.655554:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 46 00000100:00100000:1.0:1787869109.702430:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869109.702763:0:22639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918638720 00000100:00100000:2.0:1787869109.702781:0:22639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918638720 00000100:00100000:2.0:1787869109.702877:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:2.0:1787869109.702892:0:22639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+28:18834:x1874715918638720:12345-192.168.204.27@tcp:103:dd.0 00010000:00010000:2.0:1787869109.702914:0:22639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787869109.703259:0:22639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0600/0x2f11f4d3bde2f1fd lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff698 expref: 28 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869109.703283:0:22639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:2.0:1787869109.703289:0:22639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787869109.703456:0:22639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+27:18834:x1874715918638720:12345-192.168.204.27@tcp:103:dd.0 Request processed in 569us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869109.703466:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 2 00000100:00100000:2.0:1787869109.723852:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869109.724069:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918638848 00000100:00100000:0.0:1787869109.724094:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918638848 00000100:00100000:0.0:1787869109.724232:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:0.0:1787869109.724245:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+27:18834:x1874715918638848:12345-192.168.204.27@tcp:58:dd.0 00010000:00010000:0.0:1787869109.724392:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f204 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.724416:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f204 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.724431:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f204 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787869109.728377:0:22656:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787869109.728425:0:22656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1787869109.728631:0:22656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1787869109.730492:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+27:18834:x1874715918638848:12345-192.168.204.27@tcp:58:dd.0 Request processed in 6232us (6639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.730512:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 47 00000100:00100000:1.0:1787869109.739397:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869109.739534:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918638976 00000100:00100000:0.0:1787869109.739551:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918638976 00000100:00100000:0.0:1787869109.739877:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 48 00000100:00100000:0.0:1787869109.739892:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+27:18834:x1874715918638976:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:0.0:1787869109.740070:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869109.740207:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2f20b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff69f expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.740289:0:22654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f204 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.740303:0:22654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2f20b lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff69f expref: 28 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.740325:0:22654:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f204 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.740341:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2f20b lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff69f expref: 28 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.740357:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:0.0:1787869109.740378:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787869109.740383:0:22654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2f20b lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff69f expref: 28 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869109.740392:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987287200, rc 0) 00000100:00100000:0.0:1787869109.740543:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+28:18834:x1874715918638976:12345-192.168.204.27@tcp:101:dd.0 Request processed in 654us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869109.740552:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 48 00000040:00080000:0.0:1787869109.922004:0:23410:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787869110.113475:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787869110.497706:0:22690:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787869110.497723:0:22690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787869110.497760:0:22690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1787869110.498383:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787869110.498588:0:22690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22690:1874715939722240:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787869110.498731:0:22690:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae727d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787869110.504973:0:22690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986f95680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22690:1874715939722240:192.168.204.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787869110.505590:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869110.506079:0:25695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918639104 00000100:00100000:0.0:1787869110.506091:0:25695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918639104 00000100:00100000:0.0:1787869110.506316:0:25695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00100000:0.0:1787869110.506331:0:25695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da98b82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+28:18835:x1874715918639104:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787869110.506375:0:25695:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787869110.506573:0:25695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da98b82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+28:18835:x1874715918639104:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 245us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869110.506582:0:25695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 49 00000100:00080000:3.0:1787869110.507433:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787869110.512819:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869110.512955:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918639232 00000100:00100000:3.0:1787869110.512969:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918639232 00000100:00100000:3.0:1787869110.513069:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:3.0:1787869110.513082:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+28:18835:x1874715918639232:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787869110.513499:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f212 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.513524:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f212 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.513540:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f212 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.515951:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f219 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.515976:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f219 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.515988:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f219 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516026:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f220 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516034:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f220 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516041:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f220 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787869110.516096:0:22655:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787869110.516101:0:22655:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787869110.516115:0:22655:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f220 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516141:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f212 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516148:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f212 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516171:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f212 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516178:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787869110.516182:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f212 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516190:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f212 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516202:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da82873f00) 00010000:00010000:3.0:1787869110.516206:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787869110.516209:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f212 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516215:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f212 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516229:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f219 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516235:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f219 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516241:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f219 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516252:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787869110.516255:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f219 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516260:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f219 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516268:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff93da82873b00) 00010000:00010000:3.0:1787869110.516270:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787869110.516273:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f219 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516279:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f219 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516295:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f220 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516302:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f220 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516308:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f220 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516313:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787869110.516316:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f220 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516322:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f220 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516341:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:3.0:1787869110.516344:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787869110.516347:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f220 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.516354:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f220 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869110.516457:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+28:18835:x1874715918639232:12345-192.168.204.27@tcp:34:lhsmtool_posix.0 Request processed in 3372us (3649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869110.516468:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 50 00000100:00100000:3.0:1787869110.526299:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869110.526416:0:25695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918639488 00000100:00100000:0.0:1787869110.526428:0:25695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918639488 00000100:00100000:0.0:1787869110.526492:0:25695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:0.0:1787869110.526502:0:25695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+28:18835:x1874715918639488:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787869110.526524:0:25695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869110.526548:0:25695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2f227 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff6a6 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.526698:0:25695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2f22e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.526714:0:25695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2f22e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.526725:0:25695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2f22e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787869110.526747:0:25695:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787869110.526837:0:25695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2f22e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.526844:0:25695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2f22e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.526851:0:25695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2f22e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.526856:0:25695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:0.0:1787869110.526860:0:25695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2f22e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.526867:0:25695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2f22e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.526879:0:25695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:0.0:1787869110.526882:0:25695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787869110.526886:0:25695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2f22e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.526903:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2f22e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.526952:0:25695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2f227 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6a6 expref: 30 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.526962:0:25695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93da82873f00) 00010000:00010000:0.0:1787869110.526965:0:25695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787869110.526969:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2f227 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6a6 expref: 30 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.526978:0:25695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286e00, rc 0) 00000100:00100000:0.0:1787869110.527046:0:25695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+29:18835:x1874715918639488:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 546us (759us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1787869110.527053:0:25695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 51 00000100:00100000:2.0:1787869110.533050:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869110.533462:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918639616 00000100:00100000:0.0:1787869110.533473:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918639616 00000100:00100000:2.0:1787869110.533675:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:2.0:1787869110.533686:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+29:18835:x1874715918639616:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787869110.533721:0:22654:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787869110.533909:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+29:18835:x1874715918639616:12345-192.168.204.27@tcp:53:lhsmtool_posix.0 Request processed in 225us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869110.533918:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 52 00000100:00100000:1.0:1787869110.548718:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869110.548850:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918639872 00000100:00100000:2.0:1787869110.548862:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918639872 00000100:00100000:2.0:1787869110.548967:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:2.0:1787869110.548978:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+29:18835:x1874715918639872:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787869110.549000:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869110.549041:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5200/0x2f11f4d3bde2f23c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff6ad expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787869110.549500:0:22656:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =59 00000004:00080000:2.0:1787869110.549509:0:22656:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+59 in llog 00000004:00080000:2.0:1787869110.549534:0:22656:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1787869110.549707:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f243 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.549722:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f243 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.549735:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f243 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.549794:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5200/0x2f11f4d3bde2f23c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6ad expref: 32 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.549813:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f243 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6ad expref: 31 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.549822:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93dab5b3ed00) 00010000:00010000:2.0:1787869110.549825:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787869110.549829:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93dab52a4200, rc 0) 00000100:00100000:2.0:1787869110.549920:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+31:18835:x1874715918639872:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 943us (1211us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1787869110.549929:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 53 00000100:00100000:0.0:1787869110.555262:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869110.555401:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918640128 00000100:00100000:3.0:1787869110.555411:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918640128 00000100:00100000:3.0:1787869110.555517:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:3.0:1787869110.555529:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+31:18835:x1874715918640128:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787869110.555594:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787869110.555623:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a4200/0x2f11f4d3bde2f243 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6ad expref: 31 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555652:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93dab5b3ed00) 00010000:00010000:3.0:1787869110.555664:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787869110.555690:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f251 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555703:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f251 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555731:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f251 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555756:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f258 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x4834af bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555764:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f258 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4834af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555771:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f258 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4834af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555818:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f251 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555825:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f251 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555831:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f251 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555838:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787869110.555842:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f251 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555850:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f251 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555858:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93da82873300) 00010000:00010000:3.0:1787869110.555861:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787869110.555865:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f251 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555878:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1c00/0x2f11f4d3bde2f251 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555890:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f258 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4834af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555896:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f258 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4834af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555902:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f258 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4834af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555906:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:3.0:1787869110.555909:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f258 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4834af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555914:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f258 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4834af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555921:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x4834af (ffff93da82873b00) 00010000:00010000:3.0:1787869110.555924:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787869110.555926:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f258 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x4834af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.555931:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f258 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x4834af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869110.556021:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+30:18835:x1874715918640128:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 493us (767us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787869110.556029:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 54 00000100:00100000:1.0:1787869110.560025:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869110.560125:0:25695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918640256 00000100:00100000:0.0:1787869110.560136:0:25695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918640256 00000100:00100000:0.0:1787869110.560315:0:25695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:0.0:1787869110.560327:0:25695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+30:18835:x1874715918640256:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787869110.560350:0:25695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787869110.560375:0:25695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2f25f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff6b4 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.560418:0:25695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2f266 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.560445:0:25695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2f266 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.560456:0:25695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2f266 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25695 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.560573:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287e00/0x2f11f4d3bde2f25f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6b4 expref: 32 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.560603:0:25695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987286e00/0x2f11f4d3bde2f266 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6b4 expref: 31 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.560612:0:25695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d9870c8700) 00010000:00010000:0.0:1787869110.560615:0:25695:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787869110.560619:0:25695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d987286e00, rc 0) 00000100:00100000:0.0:1787869110.560688:0:25695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+31:18835:x1874715918640256:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 364us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869110.560695:0:25695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:1.0:1787869110.563688:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869110.564527:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918640512 00000100:00100000:2.0:1787869110.564539:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918640512 00000100:00100000:2.0:1787869110.564615:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:2.0:1787869110.564625:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+31:18835:x1874715918640512:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787869110.564759:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5200/0x2f11f4d3bde2f26d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.564778:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5200/0x2f11f4d3bde2f26d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.564791:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5200/0x2f11f4d3bde2f26d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787869110.564974:0:22654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:2.0:1787869110.564986:0:22654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734690829766ns, next at 735690826920ns, rc = 0 00000004:00010000:2.0:1787869110.565430:0:22654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000973bd92 reply state 00000000598ff171 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5200/0x2f11f4d3bde2f26d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.565446:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5200/0x2f11f4d3bde2f26d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.565455:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d9870c8700) 00010000:00010000:2.0:1787869110.565458:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787869110.565461:0:22654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787869110.565572:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+33:18835:x1874715918640512:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 946us (1891us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1787869110.565588:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:3.0:1787869110.573189:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869110.573283:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918640640 00000100:00100000:2.0:1787869110.573293:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918640640 00000100:00100000:2.0:1787869110.573352:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:2.0:1787869110.573362:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+33:18835:x1874715918640640:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787869110.573389:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869110.573414:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2f274 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff6bb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.573476:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2f274 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6bb expref: 34 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.573493:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2f274 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6bb expref: 34 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.573515:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d9870c8700) 00010000:00010000:2.0:1787869110.573518:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787869110.573523:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d200, rc 0) 00000100:00100000:2.0:1787869110.573594:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+34:18835:x1874715918640640:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 226us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869110.573602:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:1.0:1787869110.581200:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869110.581457:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918640768 00000100:00100000:0.0:1787869110.581469:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918640768 00000100:00100000:0.0:1787869110.581552:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:0.0:1787869110.581567:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2404:x1874715918640768:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787869110.581923:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787869110.582056:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+6:2404:x1874715918640768:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 493us (909us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1787869110.582065:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:3.0:1787869110.588869:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869110.589029:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918641024 00000100:00100000:0.0:1787869110.589063:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918641024 00000100:00100000:0.0:1787869110.589126:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:0.0:1787869110.589137:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+34:18835:x1874715918641024:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787869110.589411:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+35:18835:x1874715918641024:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 275us (552us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1787869110.589419:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 9 00000100:00100000:3.0:1787869110.593528:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869110.593966:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918641280 00000100:00100000:2.0:1787869110.593977:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918641280 00000100:00100000:2.0:1787869110.594064:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:2.0:1787869110.594077:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+35:18835:x1874715918641280:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787869110.594254:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+35:18835:x1874715918641280:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 180us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869110.594262:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:1.0:1787869110.598419:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869110.598804:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918641408 00000100:00100000:2.0:1787869110.598816:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918641408 00000100:00100000:2.0:1787869110.598880:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:2.0:1787869110.598890:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+35:18835:x1874715918641408:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787869110.598911:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869110.598945:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2f27b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff6c2 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.599402:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2f282 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.599418:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2f282 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.599430:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2f282 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787869110.599479:0:22656:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787869110.599499:0:22656:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2f282 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.599527:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c200/0x2f11f4d3bde2f27b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6c2 expref: 37 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.599546:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2f282 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6c2 expref: 36 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.599553:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d9870c8700) 00010000:00010000:2.0:1787869110.599556:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787869110.599561:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828d000, rc 0) 00000100:00100000:2.0:1787869110.599657:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+36:18835:x1874715918641408:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 768us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869110.599665:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 59 00000100:00100000:1.0:1787869110.610140:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869110.610395:0:24161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918641536 00000100:00100000:2.0:1787869110.610406:0:24161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918641536 00000100:00100000:2.0:1787869110.610511:0:24161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:2.0:1787869110.610522:0:24161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+6:2403:x1874715918641536:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787869110.610542:0:24161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869110.610562:0:24161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb1c5a7b/0x2f11f4d3bde2f289 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff6c9 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787869110.610600:0:24161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90b7b6, blocks: 0x0 00010000:00010000:2.0:1787869110.610623:0:24161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1787869110.610629:0:24161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869110.610650:0:24161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb1c5a7b/0x2f11f4d3bde2f289 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6c9 expref: 7 pid: 24161 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.610670:0:24161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb1c5a7b/0x2f11f4d3bde2f289 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6c9 expref: 7 pid: 24161 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.610685:0:24161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828c200, rc 0) 00000100:00100000:2.0:1787869110.610750:0:24161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+7:2403:x1874715918641536:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 230us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869110.610765:0:24161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:3.0:1787869110.615341:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869110.615422:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918641792 00000100:00100000:2.0:1787869110.615433:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918641792 00000100:00100000:2.0:1787869110.615496:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:2.0:1787869110.615505:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+36:18835:x1874715918641792:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787869110.615729:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+36:18835:x1874715918641792:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 224us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869110.615793:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 60 00000100:00100000:1.0:1787869110.619307:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869110.619436:0:25695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918641920 00000100:00100000:0.0:1787869110.619447:0:25695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918641920 00000100:00100000:1.0:1787869110.620696:0:25695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:1.0:1787869110.620710:0:25695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+36:18835:x1874715918641920:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787869110.623120:0:22634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:0.0:1787869110.623134:0:22634:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787869110.623210:0:22634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1787869110.623507:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f07c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623521:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f07c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623528:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f07c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623533:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0e00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787869110.623538:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f07c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623545:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f07c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623561:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff93da82873d00) 00010000:00010000:1.0:1787869110.623564:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787869110.623569:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f07c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623576:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0e00/0x2f11f4d3bde2f07c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623609:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f083 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623627:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f083 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623633:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f083 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623649:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb1a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787869110.623653:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f083 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623660:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f083 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623669:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93da82873300) 00010000:00010000:1.0:1787869110.623671:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787869110.623674:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f083 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623681:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1a00/0x2f11f4d3bde2f083 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623695:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5a00/0x2f11f4d3bde2f163 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623701:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5a00/0x2f11f4d3bde2f163 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623708:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5a00/0x2f11f4d3bde2f163 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623713:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a5a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787869110.623721:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5a00/0x2f11f4d3bde2f163 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623728:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5a00/0x2f11f4d3bde2f163 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623748:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff93dab5b3eb00) 00010000:00010000:1.0:1787869110.623751:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787869110.623754:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5a00/0x2f11f4d3bde2f163 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623768:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5a00/0x2f11f4d3bde2f163 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623785:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f1f6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623791:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f1f6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623797:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f1f6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623801:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a5c00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787869110.623804:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f1f6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623810:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f1f6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623818:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:1.0:1787869110.623821:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787869110.623831:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f1f6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623837:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5c00/0x2f11f4d3bde2f1f6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623849:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5200/0x2f11f4d3bde2f26d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623855:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5200/0x2f11f4d3bde2f26d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623861:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5200/0x2f11f4d3bde2f26d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623865:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab52a5200 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787869110.623868:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5200/0x2f11f4d3bde2f26d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623874:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5200/0x2f11f4d3bde2f26d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623881:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d9870c8700) 00010000:00010000:1.0:1787869110.623883:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787869110.623886:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5200/0x2f11f4d3bde2f26d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623890:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab52a5200/0x2f11f4d3bde2f26d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623924:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2f108 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623930:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2f108 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623942:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2f108 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623946:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0000 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:1.0:1787869110.623949:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2f108 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623954:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2f108 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623961:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93da82873300) 00010000:00010000:1.0:1787869110.623964:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787869110.623966:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2f108 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.623971:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0000/0x2f11f4d3bde2f108 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869110.623989:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787869110.624006:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939722368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787869110.624287:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869110.624424:0:25695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+15:18835:x1874715918641920:12345-192.168.204.27@tcp:44:lhsmtool_posix.0 Request processed in 3715us (5276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869110.624434:0:25695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 61 00000100:00100000:3.0:1787869110.624509:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939722368 00000100:00100000:3.0:1787869110.624517:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939722368 00000100:00100000:3.0:1787869110.624562:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787869110.624570:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874715939722368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787869110.624718:0:24162:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787869110.624722:0:24162:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787869110.624725:0:24162:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787869110.624727:0:24162:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787869110 -> 1787869110 00002000:00010000:3.0:1787869110.624730:0:24162:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787869110.624779:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1874715939722368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 209us (491us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787869110.624787:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:3.0:1787869110.624941:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d9882db480/2, rc 0, transno 12884901892 00000100:00100000:3.0:1787869110.624948:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3636:1874715939722368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787869110.629111:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869110.629276:0:24160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918642048 00000100:00100000:0.0:1787869110.629285:0:24160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918642048 00000100:00100000:0.0:1787869110.629382:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:0.0:1787869110.629394:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+7:2406:x1874715918642048:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787869110.629508:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+7:2406:x1874715918642048:12345-192.168.204.27@tcp:16:lhsmtool_posix.0 Request processed in 115us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869110.629516:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 26 00000100:00100000:2.0:1787869110.633636:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869110.634237:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918642304 00000100:00100000:3.0:1787869110.634249:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918642304 00000100:00100000:3.0:1787869110.634367:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:3.0:1787869110.634379:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+15:18835:x1874715918642304:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787869110.634431:0:22654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787869110.634460:0:22654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d000/0x2f11f4d3bde2f282 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6c2 expref: 15 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.634494:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d9870c8700) 00010000:00010000:3.0:1787869110.634500:0:22654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787869110.634531:0:22654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f290 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.634545:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f290 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.634555:0:22654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f290 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787869110.634709:0:22654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c09157d9 reply state 00000000bb5d97be transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f290 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.634722:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0a00/0x2f11f4d3bde2f290 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.634729:0:22654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d9870c8700) 00010000:00010000:3.0:1787869110.634731:0:22654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787869110.634858:0:22654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787869110.634988:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+16:18835:x1874715918642304:12345-192.168.204.27@tcp:36:lhsmtool_posix.0 Request processed in 610us (1359us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1787869110.634996:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 62 00000100:00100000:1.0:1787869110.638395:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869110.638492:0:24161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918642432 00000100:00100000:2.0:1787869110.638502:0:24161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918642432 00000100:00100000:2.0:1787869110.638557:0:24161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:2.0:1787869110.638568:0:24161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986f95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+7:18835:x1874715918642432:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787869110.638597:0:24161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869110.638616:0:24161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c449bb9/0x2f11f4d3bde2f297 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff6d0 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.638659:0:24161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb1c5a7b/0x2f11f4d3bde2f289 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6c9 expref: 8 pid: 24161 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.638669:0:24161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869110.638674:0:24161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787869110.638679:0:24161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c449bb9/0x2f11f4d3bde2f297 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6d0 expref: 8 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.638718:0:24161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb1c5a7b/0x2f11f4d3bde2f289 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6c9 expref: 8 pid: 24161 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.638733:0:24161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb1c5a7b/0x2f11f4d3bde2f289 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6c9 expref: 8 pid: 24161 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869110.638774:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24161:1874715939722496:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787869110.638862:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae7a6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787869110.642617:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24161:1874715939722496:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787869110.642669:0:24161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001c449bb9/0x2f11f4d3bde2f297 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6d0 expref: 8 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.642691:0:24161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828ca00, rc 0) 00000100:00100000:2.0:1787869110.642823:0:24161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986f95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+8:18835:x1874715918642432:12345-192.168.204.27@tcp:101:lhsmtool_posix.0 Request processed in 4256us (4439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869110.642832:0:24161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 27 00000100:00100000:1.0:1787869110.645195:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869110.645757:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918642560 00000100:00100000:3.0:1787869110.645768:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918642560 00010000:00010000:3.0:1787869110.645810:0:22640:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb1c5a7b/0x2f11f4d3bde2f289 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6c9 expref: 8 pid: 24161 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869110.645895:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:3.0:1787869110.645918:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+8:2403:x1874715918642560:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787869110.645947:0:22640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787869110.645970:0:22640:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb1c5a7b/0x2f11f4d3bde2f289 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6c9 expref: 8 pid: 24161 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.645984:0:22640:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb1c5a7b/0x2f11f4d3bde2f289 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6c9 expref: 8 pid: 24161 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.646009:0:22640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb1c5a7b/0x2f11f4d3bde2f289 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6c9 expref: 8 pid: 24161 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.646029:0:22640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869110.646044:0:22640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869110.646050:0:22640:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c449bb9/0x2f11f4d3bde2f297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6d0 expref: 7 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.646060:0:22640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c449bb9/0x2f11f4d3bde2f297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6d0 expref: 7 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.646096:0:22640:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001c449bb9/0x2f11f4d3bde2f297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6d0 expref: 7 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869110.646109:0:22640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:22640:1874715939722624:192.168.204.27@tcp:105: 00000100:00100000:3.0:1787869110.646215:0:22640:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9872c9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787869110.652709:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869110.652896:0:22640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9882d9a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:22640:1874715939722624:192.168.204.27@tcp:105: 00010000:00010000:3.0:1787869110.652933:0:22640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787869110.652997:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+7:2403:x1874715918642560:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 7079us (7838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869110.653011:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 19 00000100:00100000:2.0:1787869110.655715:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918642688 00000100:00100000:2.0:1787869110.655841:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918642688 00000100:00100000:2.0:1787869110.655950:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:2.0:1787869110.655962:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+7:2403:x1874715918642688:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787869110.656147:0:24665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787869110.656150:0:24665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787869109 00002000:00010000:2.0:1787869110.656152:0:24665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787869108 00002000:00010000:2.0:1787869110.656172:0:24665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787869110 -> 1787869109 00002000:00010000:2.0:1787869110.656175:0:24665:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787869110.656245:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+8:2403:x1874715918642688:12345-192.168.204.27@tcp:2:lhsmtool_posix.0 Request processed in 284us (3547us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1787869110.656253:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 28 00000100:00100000:1.0:1787869110.660014:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869110.660194:0:24160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918642816 00000100:00100000:0.0:1787869110.660204:0:24160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918642816 00000100:00100000:0.0:1787869110.660262:0:24160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:0.0:1787869110.660273:0:24160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+8:2404:x1874715918642816:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787869110.660319:0:24160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2f29e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.660340:0:24160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c449bb9/0x2f11f4d3bde2f297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6d0 expref: 8 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.660360:0:24160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787869110.660365:0:24160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787869110.660370:0:24160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2f29e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.660407:0:24160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c449bb9/0x2f11f4d3bde2f297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6d0 expref: 8 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.660421:0:24160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c449bb9/0x2f11f4d3bde2f297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6d0 expref: 8 pid: 24161 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869110.660437:0:24160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24160:1874715939722752:192.168.204.27@tcp:104: 00000100:00100000:0.0:1787869110.660526:0:24160:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9870e8780 going to sleep for 11 seconds 00000100:00100000:1.0:1787869110.663674:0:24160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24160:1874715939722752:192.168.204.27@tcp:104: 00010000:00010000:1.0:1787869110.663708:0:24160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2f29e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869110.665284:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869110.665375:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918642944 00000100:00100000:0.0:1787869110.665383:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918642944 00010000:00010000:0.0:1787869110.665424:0:24187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c449bb9/0x2f11f4d3bde2f297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6d0 expref: 9 pid: 24161 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869110.665467:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 20 00000100:00100000:0.0:1787869110.665477:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+9:2404:x1874715918642944:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787869110.665493:0:24187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787869110.665514:0:24187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c449bb9/0x2f11f4d3bde2f297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6d0 expref: 9 pid: 24161 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.665546:0:24187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c449bb9/0x2f11f4d3bde2f297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6d0 expref: 9 pid: 24161 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.665570:0:24187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c449bb9/0x2f11f4d3bde2f297 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6d0 expref: 9 pid: 24161 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.665589:0:24187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787869110.665594:0:24187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787869110.665599:0:24187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2f29e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.665609:0:24187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2f29e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.665649:0:24187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787869110.665710:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+8:2404:x1874715918642944:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 234us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869110.665718:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 20 00010000:00010000:1.0:1787869110.666206:0:24160:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2f29e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.666217:0:24160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2f29e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.666239:0:24160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2f29e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.666247:0:24160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2f29e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.666254:0:24160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2f29e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.666261:0:24160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:1.0:1787869110.666264:0:24160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2f29e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.666272:0:24160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2f29e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.666298:0:24160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2f29e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.666305:0:24160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003af6a1bc/0x2f11f4d3bde2f29e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787869110.666358:0:24160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+7:2404:x1874715918642816:12345-192.168.204.27@tcp:1:lhsmtool_posix.0 Request processed in 6087us (6354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869110.666366:0:24160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 29 00000100:00100000:1.0:1787869110.670733:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869110.670870:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918643200 00000100:00100000:2.0:1787869110.670896:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918643200 00000100:00100000:2.0:1787869110.670961:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 63 00000100:00100000:2.0:1787869110.670971:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+16:18835:x1874715918643200:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787869110.671073:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.671090:0:22656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f1ef lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff691 expref: 16 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.671099:0:22656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.671132:0:22656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f1ef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff691 expref: 16 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.671146:0:22656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f1ef lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff691 expref: 16 pid: 22654 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869110.671197:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22656:1874715939722880:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787869110.671272:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae7a6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787869110.674099:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22656:1874715939722880:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787869110.674129:0:22656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869110.675441:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869110.675961:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918643328 00000100:00100000:2.0:1787869110.675971:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918643328 00010000:00010000:2.0:1787869110.676010:0:22641:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f1ef lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff691 expref: 17 pid: 22654 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869110.676086:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1787869110.676096:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+17:2403:x1874715918643328:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787869110.676114:0:22641:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787869110.676122:0:22641:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f1ef lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff691 expref: 17 pid: 22654 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.676136:0:22641:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f1ef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff691 expref: 17 pid: 22654 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.676175:0:22641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb1200/0x2f11f4d3bde2f1ef lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff691 expref: 17 pid: 22654 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.676194:0:22641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:2.0:1787869110.676200:0:22641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2f20b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff69f expref: 16 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.676212:0:22641:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.676220:0:22641:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.676228:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.676254:0:22641:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787869110.676316:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+16:2403:x1874715918643328:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 221us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869110.676330:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00010000:00010000:2.0:1787869110.676358:0:22656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.676366:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.676563:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.676577:0:22656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2f274 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6bb expref: 16 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.676586:0:22656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.676616:0:22656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2f274 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6bb expref: 16 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.676629:0:22656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2f274 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6bb expref: 16 pid: 22656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869110.676655:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22656:1874715939723008:192.168.204.27@tcp:104: 00000100:00100000:2.0:1787869110.676709:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae7a6180 going to sleep for 11 seconds 00000100:00100000:2.0:1787869110.680622:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22656:1874715939723008:192.168.204.27@tcp:104: 00010000:00010000:2.0:1787869110.680664:0:22656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869110.681197:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869110.681280:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918643456 00000100:00100000:0.0:1787869110.681287:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918643456 00010000:00010000:0.0:1787869110.681324:0:24187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2f274 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6bb expref: 17 pid: 22656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787869110.681359:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:0.0:1787869110.681369:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9882da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+17:2404:x1874715918643456:12345-192.168.204.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787869110.681393:0:24187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787869110.681400:0:24187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2f274 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6bb expref: 17 pid: 22656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.681413:0:24187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2f274 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6bb expref: 17 pid: 22656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.681437:0:24187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828d200/0x2f11f4d3bde2f274 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6bb expref: 17 pid: 22656 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.681453:0:24187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d9870c8700) 00010000:00010000:0.0:1787869110.681458:0:24187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.681467:0:24187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.681476:0:24187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787869110.681513:0:24187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787869110.681564:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9882da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+16:2404:x1874715918643456:12345-192.168.204.27@tcp:103:ldlm_bl.0 Request processed in 196us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869110.681573:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00010000:00010000:3.0:1787869110.682077:0:22656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.682086:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787869110.682224:0:22656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1787869110.682346:0:22656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1787869110.682388:0:22656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1787869110.682469:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d989054780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22656:1874715939723136:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787869110.682520:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787869110.682552:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff93dab5e03600 going to sleep for 11 seconds 00000100:00100000:0.0:1787869110.682723:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939723136 00000100:00100000:0.0:1787869110.682730:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939723136 00000100:00100000:0.0:1787869110.682779:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787869110.682787:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9890561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22656:x1874715939723136:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787869110.682869:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9890561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22656:x1874715939723136:12345-0@lo:1000:mdt00_002.0 Request processed in 82us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869110.682887:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787869110.683270:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d989054780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22656:1874715939723136:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787869110.683412:0:22656:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1787869110.683462:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22656:1874715939723264:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787869110.683510:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869110.683536:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae7a6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787869110.683587:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939723264 00000100:00100000:0.0:1787869110.683592:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939723264 00000100:00100000:0.0:1787869110.683612:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787869110.683617:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22656:x1874715939723264:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787869110.683745:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22656:x1874715939723264:12345-0@lo:1000:mdt00_002.0 Request processed in 127us (234us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1787869110.683752:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787869110.685041:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22656:1874715939723264:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787869110.685090:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685100:0:22656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685107:0:22656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685113:0:22656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828de00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787869110.685118:0:22656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685127:0:22656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685142:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d9870c8700) 00010000:00010000:2.0:1787869110.685145:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787869110.685150:0:22656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685178:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828de00/0x2f11f4d3bde2f2ac lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685223:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f204 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685229:0:22656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f204 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685236:0:22656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f204 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685241:0:22656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d987287a00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787869110.685244:0:22656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f204 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685250:0:22656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f204 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685258:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:2.0:1787869110.685260:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787869110.685267:0:22656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2f20b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff69f expref: 19 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685278:0:22656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2f20b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff69f expref: 19 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685288:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2f20b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff69f expref: 19 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.685347:0:22656:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287200/0x2f11f4d3bde2f20b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff69f expref: 19 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869110.685372:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93da932b12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22656:1874715939723392:192.168.204.27@tcp:105: 00000100:00100000:2.0:1787869110.685454:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff93daae7a6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787869110.688324:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93da932b12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22656:1874715939723392:192.168.204.27@tcp:105: 00010000:00010000:2.0:1787869110.688354:0:22656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f204 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688364:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d987287a00/0x2f11f4d3bde2f204 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688394:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2f2b3 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688407:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2f2b3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688418:0:22656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2f2b3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688429:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2f2b3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688436:0:22656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2f2b3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688442:0:22656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2f2b3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688448:0:22656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828dc00 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787869110.688452:0:22656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2f2b3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688472:0:22656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2f2b3 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688485:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:2.0:1787869110.688488:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787869110.688492:0:22656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2f2b3 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688498:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828dc00/0x2f11f4d3bde2f2b3 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688508:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688515:0:22656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688521:0:22656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688526:0:22656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98828c400 already unused, calling callback (ffffffffc1a3f4f0) 00010000:00010000:2.0:1787869110.688529:0:22656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688535:0:22656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688543:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:2.0:1787869110.688545:0:22656:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787869110.688548:0:22656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.688563:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c400/0x2f11f4d3bde2f2a5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22656 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869110.689413:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936101de-59ce-47a1-a4e4-2399b6c68a10+19:18835:x1874715918643200:12345-192.168.204.27@tcp:57:lhsmtool_posix.0 Request processed in 18437us (18685us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1787869110.689426:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 63 00000020:00080000:2.0:1787869110.689432:0:22656:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787869110.690837:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869110.690941:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918643584 00000100:00100000:1.0:1787869110.690952:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918643584 00000100:00100000:1.0:1787869110.691004:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:1.0:1787869110.691015:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da93187050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+19:18834:x1874715918643584:12345-192.168.204.27@tcp:49:dd.0 00000100:00100000:1.0:1787869110.691178:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da93187050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+19:18834:x1874715918643584:12345-192.168.204.27@tcp:49:dd.0 Request processed in 140us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869110.691187:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 10 00000100:00100000:1.0:1787869110.693611:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869110.693898:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918643840 00000100:00100000:3.0:1787869110.693907:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918643840 00000100:00100000:3.0:1787869110.693973:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 11 00000100:00100000:3.0:1787869110.693983:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+19:18835:x1874715918643840:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787869110.694271:0:22658:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787869110.694301:0:22658:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1787869110.694331:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f2ba lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.694348:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f2ba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.694373:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f2ba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.694382:0:22658:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f2ba lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.694388:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f2ba lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.694393:0:22658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f2ba lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.694410:0:22658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787869110.694495:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+21:18835:x1874715918643840:12345-192.168.204.27@tcp:35:lhsmtool_posix.0 Request processed in 512us (894us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1787869110.694503:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 11 00000020:00080000:3.0:1787869110.694508:0:22658:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787869110.694537:0:22642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787869110.694543:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f2ba lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.694551:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869110.694554:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f2ba lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.694562:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f2ba lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.694575:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d9870c8700) 00010000:00010000:3.0:1787869110.694590:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787869110.694602:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f2ba lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.694608:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93dab6fb0400/0x2f11f4d3bde2f2ba lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.694621:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869110.694623:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787869110.694624:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787869110.698988:0:22690:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787869110.698997:0:22690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787869110.699015:0:22690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787869110.699021:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787869110.699347:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869110.699796:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918643968 00000100:00100000:2.0:1787869110.699806:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918643968 00000100:00100000:2.0:1787869110.699863:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:2.0:1787869110.699874:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+21:18834:x1874715918643968:12345-192.168.204.27@tcp:101:dd.0 00010000:00010000:2.0:1787869110.699896:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787869110.699919:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2f2c1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x87163cb6963ff6d7 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.699956:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2f2c8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.699971:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2f2c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.699982:0:22655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2f2c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22655 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.700097:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828c600/0x2f11f4d3bde2f2c1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6d7 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.700117:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98828ce00/0x2f11f4d3bde2f2c8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.27@tcp remote: 0x87163cb6963ff6d7 expref: 22 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869110.700136:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93dab5b3e900) 00010000:00010000:2.0:1787869110.700138:0:22655:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787869110.700142:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98828ce00, rc 0) 00000100:00100000:2.0:1787869110.700234:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936101de-59ce-47a1-a4e4-2399b6c68a10+22:18834:x1874715918643968:12345-192.168.204.27@tcp:101:dd.0 Request processed in 361us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869110.700241:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 64 00000100:00100000:3.0:1787869110.917285:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:1.0:1787869110.917679:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918644096 00000100:00100000:1.0:1787869110.917697:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918644096 00000100:00100000:1.0:1787869110.917799:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 0 00000100:00100000:1.0:1787869110.918192:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989055e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+7:2405:x1874715918644096:12345-192.168.204.27@tcp:4:dd.0 00002000:00010000:1.0:1787869110.918263:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a90b7b5, atime: 0x6a90b7b4, ctime: 0x6a90b7b5, blocks: 0x0 00010000:00010000:1.0:1787869110.918296:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2f2cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.918319:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=735s v=(0 0) 00010000:00010000:1.0:1787869110.918324:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787869110.918332:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2f2cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787869110.918355:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2f2cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869110.925106:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:0.0:1787869110.925272:0:24167:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787869110.925288:0:24167:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787869110.926306:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918644224 00000100:00100000:0.0:1787869110.926317:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918644224 00000100:00100000:3.0:1787869110.927390:0:25701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 1 00000100:00100000:3.0:1787869110.927405:0:25701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989057840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+8:2405:x1874715918644224:12345-192.168.204.27@tcp:4:dd.0 00010000:00010000:3.0:1787869110.927445:0:25701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2f2d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.927464:0:25701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869110.927469:0:25701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787869110.927476:0:25701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2f2d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869110.927491:0:25701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2f2d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787869111.035197:0:24979:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:0.0:1787869111.035219:0:24979:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1787869111.035427:0:25701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1787869111.035432:0:25701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1787869109 -> 1787869110 00002000:00010000:2.0:1787869111.035435:0:25701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787869109 -> 1787869110 00002000:00010000:2.0:1787869111.035437:0:25701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1787869111.035454:0:25701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2f2d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869111.035468:0:25701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2f2d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869111.035477:0:25701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2f2d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869111.035485:0:25701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6fb0400 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:2.0:1787869111.035490:0:25701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2f2d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869111.035499:0:25701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2f2d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869111.035536:0:25701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2f2d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787869111.035544:0:25701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000975c96f0/0x2f11f4d3bde2f2d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787869111.035952:0:25701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989057840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+7:2405:x1874715918644224:12345-192.168.204.27@tcp:4:dd.0 Request processed in 108544us (110855us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1787869111.035968:0:25701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 1 00000001:00080000:2.0:1787869111.096626:0:24979:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:3.0:1787869111.096926:0:24165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:3.0:1787869111.096958:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2f2cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869111.096974:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2f2cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869111.097005:0:24165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2f2cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869111.097012:0:24165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93dab6f1ae00 already unused, calling callback (ffffffffc0e33500) 00010000:00010000:3.0:1787869111.097018:0:24165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2f2cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869111.097029:0:24165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2f2cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869111.097056:0:24165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2f2cf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787869111.097065:0:24165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e0eb95e/0x2f11f4d3bde2f2cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787869111.097307:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989055e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2405:x1874715918644096:12345-192.168.204.27@tcp:4:dd.0 Request processed in 179152us (180026us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1787869111.097321:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 0 00010000:00010000:1.0:1787869111.138292:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787869111.530805:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869111.530855:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869111.530897:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869111.530933:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918644352 00000100:00100000:2.0:1787869111.530953:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869111.530955:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918644352 00000100:00100000:2.0:1787869111.530990:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869111.531027:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:2.0:1787869111.531054:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869111.531072:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:3.0:1787869111.531089:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da813fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:2404:x1874715918644352:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787869111.531090:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918644864 00000100:00100000:2.0:1787869111.531102:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918644864 00000100:00100000:2.0:1787869111.531224:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918645376 00000100:00100000:2.0:1787869111.531229:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918645376 00000100:00100000:2.0:1787869111.531273:0:24665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918644736 00000100:00100000:3.0:1787869111.531276:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da813fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c835a62-7e87-43e5-a943-aa5b200c88fb+13:2404:x1874715918644352:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 189us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869111.531279:0:24665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918644736 00000100:00100000:2.0:1787869111.531302:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1787869111.531313:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2404:x1874715918644864:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787869111.531340:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 167 00000100:00100000:2.0:1787869111.531408:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2404:x1874715918644864:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 95us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869111.531411:0:24907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:3.0:1787869111.531424:0:24907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4fbf5987-99e2-47fc-b779-44fc89496406+5:2404:x1874715918645376:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787869111.531444:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 21 00000100:00100000:2.0:1787869111.531474:0:24665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:3.0:1787869111.531481:0:24907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4fbf5987-99e2-47fc-b779-44fc89496406+5:2404:x1874715918645376:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 55us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869111.531492:0:24665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2404:x1874715918644736:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787869111.531496:0:24907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 22 00000100:00100000:3.0:1787869111.531533:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918644608 00000100:00100000:3.0:1787869111.531541:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918644608 00000100:00100000:2.0:1787869111.531548:0:24665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2404:x1874715918644736:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 57us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869111.531558:0:24665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 23 00000100:00100000:3.0:1787869111.531590:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918645120 00000100:00100000:3.0:1787869111.531596:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918645120 00000100:00100000:2.0:1787869111.531618:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869111.531637:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918644480 00000100:00100000:3.0:1787869111.531641:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918644480 00000100:00100000:3.0:1787869111.531661:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:3.0:1787869111.531668:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2404:x1874715918644608:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787869111.531705:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+5:2404:x1874715918644608:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 38us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869111.531712:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 55 00000100:00100000:3.0:1787869111.531725:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:3.0:1787869111.531731:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+5:2404:x1874715918645120:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787869111.531755:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+5:2404:x1874715918645120:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 24us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869111.531761:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 56 00000100:00100000:3.0:1787869111.531775:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918644992 00000100:00100000:3.0:1787869111.531780:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918644992 00000100:00100000:3.0:1787869111.531806:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:3.0:1787869111.531827:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+22:2404:x1874715918644480:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:2.0:1787869111.531857:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.27@tcp (source: 12345-192.168.204.27@tcp) 00000100:00100000:3.0:1787869111.531873:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936101de-59ce-47a1-a4e4-2399b6c68a10+22:2404:x1874715918644480:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 47us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869111.531882:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 57 00000100:00100000:3.0:1787869111.531906:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:3.0:1787869111.531916:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+6:2404:x1874715918644992:12345-192.168.204.27@tcp:400:kworker.0 00000100:00100000:3.0:1787869111.531957:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4fbf5987-99e2-47fc-b779-44fc89496406+6:2404:x1874715918644992:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 44us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787869111.531965:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 58 00000100:00100000:3.0:1787869111.531996:0:24162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715918645248 00000100:00100000:3.0:1787869111.532000:0:24162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715918645248 00000100:00100000:3.0:1787869111.532053:0:24162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00100000:3.0:1787869111.532066:0:24162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93da932b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4fbf5987-99e2-47fc-b779-44fc89496406+5:2404:x1874715918645248:12345-192.168.204.27@tcp:400:kworker.0 00000100:00080000:2.0:1787869111.532108:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787869111.532110:0:24162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93da932b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4fbf5987-99e2-47fc-b779-44fc89496406+5:2404:x1874715918645248:12345-192.168.204.27@tcp:400:kworker.0 Request processed in 47us (254us total) trans 0 rc 0/0 00000100:00080000:2.0:1787869111.532117:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787869111.532123:0:24162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.27@tcp, seq: 24 00000100:00080000:2.0:1787869111.532125:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787869111.532131:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787869112.161430:0:22643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787869113.117542:0:25738:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787869113.186361:0:22642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787869113.634454:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787869113.634490:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9890570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939723520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787869113.634607:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869113.635114:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939723648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787869113.635151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787869113.635265:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939723520 00000100:00100000:1.0:1787869113.635276:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939723520 00000100:00100000:1.0:1787869113.635356:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939723648 00000100:00100000:1.0:1787869113.635360:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939723648 00000100:00100000:1.0:1787869113.635382:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787869113.635393:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939723520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787869113.635437:0:24164:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787869113.635497:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874715939723520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869113.635505:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787869113.635538:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787869113.635547:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939723648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787869113.635558:0:24164:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787869113.635594:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874715939723648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787869113.635601:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787869113.636024:0:22650:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787869113.636076:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3639:1874715939723648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787869113.636091:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9890570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3639:1874715939723520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787869114.147254:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787869114.147291:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab7f6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939723776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787869114.147386:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787869114.147450:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939723776 00000100:00100000:0.0:1787869114.147459:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939723776 00000100:00100000:0.0:1787869114.147532:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787869114.147544:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab7f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939723776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787869114.147611:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1787869114.148009:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93dab6e983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939723904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787869114.148047:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787869114.151730:0:22659:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787869114.151752:0:22659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787869114.151956:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874715939723904 00000100:00100000:2.0:1787869114.151969:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874715939723904 00000100:00100000:2.0:1787869114.152134:0:25762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787869114.152147:0:25762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93dab6e98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939723904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787869114.152219:0:25762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787869114.152351:0:25762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab6e98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874715939723904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 207us (4303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787869114.152360:0:25762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787869114.152602:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab6e983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3637:1874715939723904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787869114.153369:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93dab7f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874715939723776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5821us (5976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787869114.153380:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787869114.155655:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93dab7f6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3637:1874715939723776:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787869114.214125:0:23808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14182 lines, 14182 kept, 0 dropped, 0 bad.